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b AND SYSTEM FOR ADAPTIVE 
OF PROGRESSIVE MKSHKS 



COPYRIGHT AUTHORIZATION 
A portion of the disclosure of this patent document contains material which is subject to 
copyright protection. The copyright owner has no objection to the facsimile reproduction by 
anyone of the patent document or the patent disclosure, as it appears in the file or records of the 
pertinent patent authority, but otherwise reserves all copyright rights. 



10 FIELP OF INVENTION 

The present invention relates to computer graphics. More particularly it relates to 
rendering complex geometric models for graphical objects in graphical images. 



BACKGROUND AND SUMMARY OF THE INVENTION 

IS Rendering complex geometric models at interactive rates is a challenging 

problem in computer graphics. While rendering performance is continually improving, significant 
gains can be obtained by ad^ting the complexity of a geometric model to the contribution the* 
model makes to a specific rendered graphical image. Within traditional modeling systems known in 
the computer graphics art, detailed geometric models are created by applying versatile modeling 

20 operations (e.g., extrusion, constructive solid geometry, and freeform deformations) to a vast array 
of geometric primitives used to define a graphical object or image. The geometric primitives 
typically include triangles, polygons, and other mullet-sided shapes. For efficient display, the 
resulting geometric models are typically transformed into polygonal approximations of geometric 
primitives called "meshes." 

25 A mesh has a geometry denoted by a tuple (K, V) where K is a simplicial complex 

specifying the connectivity of the mesh simplicies (i.e., the adjacency of the vertices, edges and 
faces). V { Vi9***v„}, is the set of vertex positions defining the shape of the mesh in R^ space. 
That is, a parametric domain |K| c R"* is constructed by identifying a vertex K with a canonical 
basis vector of R*", and defining the mesh as an image (|>v(|K|) where (|>v: R*" RMs a linear 

30 map. For more information on meshes, see Mesh Optimization, by Hugues Hoppe, T. DeRose, T. 
Duchamp J. McDonald, and W. Stuetzle, ACM SIGGRAPH'93 Proceedings, pp. 19-26. 

Many geometric models in computer graphics are represented using triangle meshes. 
Geometrically, a triangle mesh is a piecewise linear surface with multiple triangular faces joined 
together at their edges. One common technique for using meshes to display a graphical object or 

35 image is to create several versions of a geometric model at various Levels Of Detail (LOD) using 
progressive meshes. Such LOD meshes can be computed automatically using various mesh 
simplification techniques known in the art. 

A Progressive Mesh (PM) representation is also used to capture a continuous 
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Q^pid for view-independent LOD control. ProgressWFm 



sequence of meshes op^pid for view-independent LOD control. ProgressWPmeshes allow for 
fast traversal of the mesh sequence at run-time. For more information see Progressive Meshes, by 
Hugues Hoppe, ACM SIGGRAPH'96 Proceedings, pp. 99-108. Sets or sequences of view- 
independent progressive LOD meshes are appropriate for many computer graphic applications. 
5 However, there are several problems associated with using view-independent progressive LOD 
meshes when rendering large-scale geometric models such as a graphical terrain or other graphical 
environments that may surround a viewer. 

One problem is that a large number of individual polygons or faces of the geometric model 
may lie outside a viewer's chosen view frusmm (i.e., a view plane), and thus do not contribute to 

10 graphical object or image when it is rendered. Even though the faces which lie outside the view 
frustum are eventually culled (i.e., discarded), processing resources are wasted during rendering 
of a graphical image or object because the same levels of detail that is applied within the view 
frustum are also applied to faces outside the view frustum. 

Another problem is the unnecessary rendering of faces oriented away from the viewer. 

IS Such faces are typically culled during rendering using a "backfacing" test. However, this 
backfacing test agam wastes significant processmg resources during rendering. 

Yet another problem is that within the view frustum some regions of the model may lie - 
much closer to the viewer than others. Progressive LOD meshes fail to provide the appropriate 
level of detail over the entire geometric model to handle such regions. 

20 Some of these problems can be addressed by representing a graphical scene 

hierarchically as a hierarchy of meshes. Parts of the scene can be adjusted independently for each 
mesh in the hierarchy. However, establishing such hierarchies on continuous surfaces of a 
graphical object or image presents additional challenging problems. 

One problem associated with establishing culling hierarchies is<that visual "cracks" 

25 may appear ui the progressive LOD meshes. For example, if a mesh representing a graphical 
terrain is partitioned into blocks, and the blocks are rendered at different levels of detail, cracks 
may appear in the terram as it is displayed. In addition, the progressive LOD mesh block 
boundaries are unlikely to correspond to natural features in the terrain surface, resulting in sub- 
optimal approximations. Similar problems also arise in adaptive tessellation of smooth parametric 

30 surfaces. 

Specialized methods known to those skilled in the graphical arts have been developed 
to adaptively refine meshes for the cases of height fields for graphical terrains, and some 
parametric surfaces. However, these methods cannot be applied in a general manner to an 
arbitrary mesh. 

35 As is known in the art, a mesh can be refined using a set of constraints on a set of 

mesh transformations and a set of fixed re.finement criteria. For example, a progressive mesh 
representation can be refined with a set of mesh transformations including an edge coUs^se 
operation and a vertex split operation constrained by a set of vertices. The set of fixed refmement 
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ij^^andidate edges for edge collapse into a priority^l^e 



criteria includes placin^^^andidate edges for edge collapse into a priority^He where the 
priority of each transformation is an energy cost that is used to fit a small number of points from 
the initial mesh into a mesh in the progressive mesh representation. For more information, see the 
Progressive Meshes paper cited above. 
5 Refining a progressive mesh representation with fixed set of refinement criteria 

presents a number of problems. The set of constraints used and the set of fixed refinement criteria 
used for progressive meshes are not adequate for adaptively refining a progressive mesh 
representation. During adaptive refinement, areas of a progressive mesh representation will be 
refined (e.g., an area pointed toward a viewer) while other areas of the same progressive mesh 

10 representation wDl be coarsened (e.g., an area pointed away from a viewer). The set of 

constrained mesh transformations and the set of fixed refinement criteria used for progressive 
meshes are also not adequate for adaptively refimng an arbitrary progressive mesh representation. 

In accordance with an illustrative embodiment of the present invention, the problems 
associated with progressive LOD meshes, culling hierarchies and adaptively refining progressive 

IS mesh representations are overcome. A method and system are described for adaptively refining an 
arbitrary progressive mesh according to changing view-dependent parameters. A general method 
for adaptively refining an arbitrary progressive mesh with a set of constrained mesh transformations 
using a set of selective refinement criteria is also presented. 

The method for adaptively refimng an arbitrary progressive mesh according to 

20 changing view-dependent parameters includes re-parameterizing a progressive mesh representation 
M*^ to create a re-parameterized progressive mesh representation M*^. The re-parameterizing 
includes the selection of new vertices, faces or edges from a sequence of N-data structure records 
associated with the progressive mesh representation. A vertex hierarchy is constructpd on the 
re-paranieterized progressive mesh representation M^. The construction of the vertex hierarchy is 

25 done using a traversal of re-parameterized vertices. However, other construction techniques could 
also be used. 

The vertex hierarchy forms a "forest" of tree structures in which the "root" nodes are 
the vertices of a progressive mesh representation (e.g., M*^) and the "leaf nodes" are the vertices of 
a re-parameterized mesh representation (e.g., M"^^). However, other types of vertex hierarchies 
30 could also be used. The establishment of the vertex hierarchy allows creation of refinement 

dependencies for vertices re-parameterized m the re-parameterized progressive mesh representation 

Values for a set of selective refinement criteria are pre-computed to make the run- 
time evaluation of the set of selective refinement criteria faster. In an alternative embodiment of 
35 the present invention, the set of selective refine criteria is completed at run-time. 

At run-time an indication is received that one or more view-dependent parameters 
have changed. The re-parameterized progressive mesh representation M*^ is adaptively refined 
using the vertex hierarchy, the pre-computed selective refinement criteria, and run-time computed 
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selective refinement cri^^^o create an adaptively refined mesh. Adaptive^l^ming the 

parameterized progressive mesh representation M*^^ includes refining areas of M*^^ with a series of 
constrained transformations as well as coarsening other areas of M^^ with a series of constrained 
transformations. 

5 The system for an illustrative embodiment of the present invention includes a 

locator/constructor module for constructing an arbitrary progressive mesh representation; a pre- 
processing module for loading the progressive mesh representation into a memory of a computer 
system, re-parameterizing die progressive mesh representation and performing pre-processing on a 
set of selective refinement criteria; and a renderer module for receiving changes in view-dependent 

10 parameters, evaluating selective refmement criteria, adaptively refining a re-parameterized 

progressive mesh representation, and rendering active faces. However, the system can include 
more or fewer modules and can combine functionality of the modules into more or fewer modules. 

The general method for adaptively refining an arbitrary progressive mesh with a set 
of constramed mesh transformations using a set of selective refmement criteria includes selecting an 

15 arbitrary progressive mesh representation. A set of mesh transformations, constraints on the set of 
mesh transformations, and a set of selective refinement criteria are selected. At run-time, the 
refinement of the progressive mesh representation is adjusted by adding geometric primitives to the 
progressive mesh representation using the constrained set of mesh transformations and the set of 
selective refmement criteria to create a first approximation of a selectively refmed mesh. The 

20 selectively refined mesh is adaptively refined by navigatmg through the selectively refined mesh. 
Adaptive refinement allows areas of the selectively refined mesh to be ftirther refmed, while other 
areas of the same selectively refmed mesh are coarsened. This method allows an arbitrary 
progressive mesh representation for an arbitrary geometric model to be adaptively refined. The 
method is also very flexible as a developer can choose the set of selective refinement criteria. The 

25 selective refmement criteria can be view-dependent, or based on some other set of dependencies 
providing flexibility to adaptively refine a progressive mesh representation for a large number of 
purposes. 

The foregoing and other feamres and advantages of the illustrative embodiment of the 
present invention will be more readily apparent from the following detailed description, which 
30 proceeds with reference to the accompanying drawings. 

BRIEF DESCRIPTION OF TH H DRAWINGS 
The file of this patent contains at least one drawing executed in color. Copies of this 
patent with color drawings(s) will be provided by the pertinent patent authority upon request and 
35 payment of the necessary fee. 

Certain ones of the drawings executed in color are images of meshes created fix)m datasets 
which was originally created and copyrighted by Viewpoint Datalabs International of Provo, Utah. 

FIG. 1 is a block diagram of a computer system used to implement an iUustrative 
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embodiment of the pre 

FIG. 2 is a block diagram of vertex split and edge collapse operations from the prior 

art. 

FIGS. 3A-3D are a sequence of color screen displays of a progressive mesh for a 
5 terrain grid using the vertex split and edge collapse operations from FIG. 2. 

FIG. 4 is a flow diagram illustrating a method for adaptively refming an arbitrary 
progressive mesh representation according to changing view-dependent parameters. 

FIG. 5 is a block diagram illustrating new edge collapse and new vertex split 
transformations. 

10 FIG. 6 is a block diagram illustrating a mesh with a boundary using the mesh 

transformations from FIG. 5. 

FIG. 7 is a flow diagram illustrating steps for the vertex split transformation shown 

in FIG. 5. 

FIG. 8 is a flow diagram illustrating steps for the edge collapse transformation shown 

15 in FIG. 5. 

FIG. 9 is a block diagram illustrating a vertex hierarchy. 
FIG. 10 is a flow diagram illustrating a method to determine if a mesh should be 
selectively refmed or coarsened. 

FIG . 1 1 is a flow diagram illustrating a method to determine if a vertex is within a view 

20 frustum. 

FIG. 12 is a block diagram illustrating a bounding space hierarchy. 
FIGS. 13A-13C are block diagrams which illustrate a surface orientation test for a vertex. 
FIG. 14 is a flow diagram illustratmg a method for determinmg surface orientation. 
FIGS. ISA-ISB are block diagrams illustrating a screen space geometric error 
25 representation. 

FIG. 16 is a flow diagram illustrating a method for finding a screen space geometric error. 
FIGS. 17A and 17B are flow diagrams illustrating a method for adaptively refining a 

mesh. 

FIG. 18 is a block diagram illustrating a vertex hierarchy for a geomorph mesh. 
30 FIG. 19 is a flow diagram illustrating a method for creating a geomorph mesh. 

FIG. 20 is a block diagram of a graphical terrain illustrating a triangle strip. 

FIG. 21 is a flow diagram illustrating a method for generating triangle strips. 

FIG. 22 is a flow diagram illustrating a method for adaptive tessellation of parametric 

surfaces. 

35 FIGS. 23 A and 23B are block diagrams illustrating a system for an illustrative 

embodiment of the present invention. 

FIGS. 24A-24F are color screen displays illustrating a view-dependent refinement of a 
progressive mesh for a graphical terrain. 
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FIGS. 25A-2si|^co]or screen displays illustrating view-depende^^^nement for a 

tessellated sphere. 

FIGS. 26A-26C are color screen displays illustrating view-dependent refinement of a 
truncated progressive mesh representation created with a tessellated parametric surface. 
5 FIGS. 27A-27C are color screen displays illustrating view-dependent refinements of an 

arbitrary mesh for a graphical character. 

FIG. 28 is a flow diagram illustrating a general method for adaptiveiy refining a mesh. 

DETAILED DESCRIPTION OF AN ILLUSTRATIVE EMBODIMENT 
10 FIG. 1 is a block diagram of a computer system used to implement an illustrative 

embodiment of the present mvention. Referring to FIG. 1, an operating environment for the 
preferred embodiment of the present invention is a computer system 10 with a computer 12 that 
comprises at least one high speed processing unit (CPU) 14, in conjunction with a memory system 
16, an input device 18, and an output device 20. These elements are interconnected by a bus 
IS structure 22. 

The illustrated CPU 14 is of familiar design and includes an ALU 24 for performing 
computations, a collection of registers 26 for temporary storage of data and instructions, and a 
control imit 28 for controlling operation of the system 10. Any of a variety of processors, 
mcluding those from Digital Equipment, Sun, MIPS, IBM, Motorola, NEC, Intel, Cyrix, AMD, 

20 Nexgen and others are equally preferred for CPU 14. Although shown with one CPU 14, 
computer system 10 may alternatively include multiple processing units. 

The memory system 16 includes main memory 30 and secondary storage 32. 
Illustrated main memory 30 is high speed random access memory (RAM) and read only memory 
(ROM). Mam memory 30 can mclude any additional or alternative high speed memory device or 

25 memory circuitry. Secondary storage 32 takes the form of long term storage, such as ROM, 
optical or magnetic disks, organic memory or any other volatile or non-volatile mass storage 
system. Those skilled in the art will recognize that memory 16 can comprise a variety and/or 
combination of alternative components. 

The mpat and output devices 18, 20 are also familiar. The input device 18 can 

30 comprise a keyboard, mouse, pointmg device, audio device (e.g., a microphone, etc.), or any other 
device providing input to the computer system 10. The output device 20 can comprise a display, a 
printer, an audio device (e.g., a speaker, etc.), or other device providing output to the computer 
system 10. The input/output devices 18, 20 can also include network connections, modems, or 
other devices used for conununications with other computer systems or devices. 

35 As is familiar to those skilled in the art, the computer system 10 further includes an 

operating system and at least one application program. The operating system is a set of software 
instructions which controls the computer system's operation and the allocation of resources. The 
application program is a set of software instructions that performs a task desired by the user, 
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ei^^irces made available through the operating syslfl^ I 



making use of computef^^urces made available through the operating systSIF^ Both are resident 
in the illustrated memory system 16. 

In accordance with the practices of persons skilled in the art of computer 
progranuning, the present invention is described below with reference to acts and symbolic 
S representations of operations that are performed by computer system 10, imless indicated 

otherwise. Such acts and operations are sometimes referred to as bemg computer-executed. It will 
be appreciated that the acts and symbolically represented operations include the manipulation by the 
CPU 14 of electrical signals representing data bits which causes a resulting transformation or 
reduction of the electrical signal representation, and the mamtenance of data bits at memory 

10 locations in memory system 16 to thereby reconfigure or otherwise alter the computer system's 
operation, as well as other processing of signals. The memory locations where data bits are 
maintained are physical locations that have particular electrical, magnetic, optical, or organic 
properties corresponding to the data bits. 

The data bits may also be maintained on a computer readable medium including 

IS magnetic disks, and any other volatile or non-volatile mass storage system readable by the 

computer 12. The computer readable medium includes cooperating or interconnected computer.. . 
readable media, which exist excltisively on computer system 10 or are distributed among multiple 
interconnected computer systems 10 that may be local or remote. 
Rendering a Graphical Object 

20 To generate a graphical object, detailed geometric models are created by applymg 

modeling operations to geometric primitives used to defme the graphical object. The geometric 
primitives typically include triangles, polygons, and other multi-sided shapes. To render a 
graphical image, graphical objects are processed and the resulting graphical image is stored in a 
frame buffer (e.g., memory system 16). The frame buffer contains a frame of graphical data. The 

25 rendered hnage data is then transferred to a display (e.g., display 20). Graphical data is stored in 
frames of a pre-determined size (e.g., 3 mega-bytes). A graphical image is typically rendered 
frame-by frame. For more uiformation on rendering, see Fundamentals of Interactive Computer 
Graphics, 2nd Edition, by J.D. Foley and A. Van Dam, Addison-Wesley Publishers. 

For efficient display in a frame, the resulting geometric models for a graphical image 

30 containing one or more graphical objects are typically transformed into polygonal approximations 
of geometric primitives called "meshes." A mesh has a geometry denoted by a tuple (K, V) where 
K is a simplicial complex specifying the connectivity of the mesh simplicies (i.e., die adjacency of 
the vertices, edges and faces). V = { Vi,...v„ }, is the set of vertex positions defmmg the shape of 
the mesh m space. That is, a parametric domain |K| c R*" is constructed by identiiymg a 

35 vertex K with a canonical basis vector of R"^, and defining the mesh as an image (|>v( | K | ) where 
<|)v: R" - RMs a linear map. One common technique for using meshes to display a graphical 
object is to create several versions of a geomettic model at various view-independent Levels Of 
Detail (LOD) usmg progressive meshes. 
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Progressive Meshes 

If M is the set of all possible meshes, a progressive mesh representation M^" of an 
arbitrary mesh M'^, where s M, and M*''^ c M, defines a continuous sequence of mesh 

approximations M' for i = {0, ... ,n-l), Nf, M"-* of increasmg accuracy from which 

5 view-independent level-of-detail approximations of any desired complexity can be efficiently 

retrieved. To create a progressive mesh representation M**" for a geometric model, an arbitrary 
mesh M"^ is simplified through a sequence of edge collapse (ecol) operations to yield a much 
simpler base mesh M° with a fixed set of refinement criteria. An illustrative progressive mesh 
simplification operation using edge collapses known in the an is shown in equation 1. 

10 (M^=M") - ecoU, - . . . ecoli - ecolo - M° (1 ) 

FIG. 2 is a block diagram illustrating an edge collapse operation 36 and a vertex split 
operation 38 known m the art. Edge collapse operation 36, parameterized as ecoliv^, Vl, Vr, Vj, 
Fl, Fr), unifies 2 adjacent vertices Vs40 and v,. 42 between two additional vertices Vl 44 and Vr 46 
from a refined mesh M*' 48 mto a single vertex Vj' 50 on a coarser mesh 52. Coarser mesh 

15 52 can be a final base mesh M**or another intermediate coarser mesh (e.g., M*, M^, . . etc.) 
in the progressive mesh representation. Vertex v^ 40 and faces F^ 54 and Fr 56 associated with^the 
vertex v^ 40 vanish in the edge collapse operation. A new mesh position is specified for the unified 
vertex Vj' 50. 

Edge course operation 36 has an inverse called a vertex split (vsplit) operation 38. 

20 An illustrative progressive mesh refinement operation using vertex splits is shown in equation 2. 

M° -> vsplito - vspliti . . . M"-^ - vsplitn^i ^ (M" = M^) (2) 
Refined mesh M** 48 can be a triangular mesh M' or any mesh in the progressive mesh sequence 
(e.g., M""', M""^, . . . etc.) shown in equation 2. A vertex split operation, parameterized as 
vsplit(Vs, Vl, Vr), modifies the coarser mesh 52 by introducing one new vertex Vj 42 and two 

25 new faces F^ 54 and Fr 56. Face Fl 54 is defined by three vertices Fl = {vj, Vl, Vt} (42,44,40). 
Face Fr 56 is defined by three vertices Fr = {vj, Vr, Vt}(42,46,40). The resulting sequence of 
meshes, M" = is effective for view-independent Level of Detail (LOD) control. For 

more information on progressive meshes usmg fixed refinement criteria, see Progressive Meshes, 
by Hugues Hoppe, ACM SIGGRAPH'96 Proceedmgs, pp. 99-108. 

30 FIGS. 3A-3D are a sequence of color block diagrams 60 illustrating screen displays 

of a view-mdependent progressive mesh representation for a terrain grid. Vertex split operation 38 
is iteratively applied to a base mesh M° 62. For example, in FIG. 3 A, a coarser base mesh M^62 
has 3 vertices and 1 face definmg a triangle, while a most refined mesh M" 68 in FIG, 3D has 
200x200 vertices, 79,202 faces and defines a graphical image of a complex terrain. FIGS. 3B and 

35 3C illustrate color screen displays (64, 66) of intermediate meshes M^" and with 1,000 and 
10,000 faces respectively. Coarser base mesh M°62 can be recovered from refined mesh M" 68 by 
iteratively applying edge collapse operation 36 to refined mesh 68. 

Progressive meshes manipulated with operations shown in equations 1 and 2 leave 
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essed. For example, progressive meshes are ^^fel 



some major problems ul^^essed. For example, progressive meshes are t^lRuly not designed to 
ensure good real-time performance for selective or adaptive refinement during the rendering 
process, fail to measure screen space geometric error and can't be used to selectively or adaptively 
refine a mesh as view-dependent parameters change. 
5 View-dependent refinement of progressive meshes 

The progressive meshes shown in FIG. 2, created with equations 1 and 2 are view- 
independent and created with a fixed set of refinement criteria. FIG. 4 is a flow diagram 
illustrating a method 70 for adaptively refining an arbitrary progressive mesh according to 
changing view-dependent parameters for an illustrative embodiment of the present invention. 

10 Method 70 is implemented as an application program in memory 16 of computer system 10 in an 
illustrative embodiment of the present mvention. However, other implementations can also be 
used. Method 70 includes re-parameterizing a progressive mesh representation M^ to create a re- 
parameterized progressive mesh representation M"^ at step 72. The re-parameterizing includes the 
selection of new vertices, faces and edges from a sequence of N-data structure records associated 

15 with the progressive mesh representation M*^. At step 74, a vertex hierarchy is. constructed on the 
re-parameterized progressive mesh representation M*^^. The construction of the vertex hierarchy^ is 
done using a traversal of re-parameterized vertices. However, other construction techniques could 
also be used. The vertex hierarchy forms a "forest" of tree structures in which the "root" nodes are 
the vertices of a progressive mesh representation (e.g., M^) and the "leaf nodes" are the vertices of 

20 a re-parameterized mesh representation (e.g., M*^^). However, other types of vertex hierarchies 
could also be used. The establishment of the vertex hierarchy allows creation of refinement 
dependencies for vertices re-parameterized in the re-parameterized progressive mesh representation 
M''^. Values for a set of selective refinement criteria are pre-computed to make the run-time 
evaluation of the set of selective refinement criteria faster at step 76. In an. alternative embodiment 

25 of the present mvention, step 76 is completed at run-time. Steps 72-76 are completed as pre- 
processing steps in an illustrative embodiment of the present invention. In an alternative 
embodiment of the present invention, steps 72-76 are completed at run-time. 

At run-time, an indication is received that one or more view-dependent parameters 
have changed at step 78. The re-parameterized progressive mesh representation M'^^ is adapdvely 

30 refined at step 80 using the vertex hierarchy the pre-computed selective refinement criteria, and 
run-time computed selective refinement criteria to create an adaptively refined niesh. Adaptively 
refining die parameterized progressive mesh representation M*^ includes refining areas of M*^"^ with 
a series of constrained vertex split transformations as well as coarsening areas of M^^ with a series 
of constrained edge collapse transformations. The constrained vertex split transformations and 

35 edge collapse transformations will be explained below. 

The resulting adaptively refined mesh requires fewer polygons (e.g., triangles) for a 
given level of detail approximation, is a geometrically optimized sequence of vertex re- 
parameterizations with a small number of vertex dependencies for a selected geometric model based 



wo 98/44445 



PCT/US98/06692 



-10- 



on changed view-depei 




tarameters. 
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Vertex split transformation 

A progressive mesh representation is re-parameterized at step 72 (FIG. 4) using 
new constrained edge collapse and vertex split transformations. The constrained new edge coll^se 
and new vertex split transformations are improvements over the progressive mesh operations shown 
in equations 1 and 2 above. The new edge collapse and new vertex split transformations take into 
account pairwise adjacent faces which are not considered in the transformations shown in equations 
1 and 2. 



a constrained edge collapse transformation 84. As is illustrated m FIG. 5, an arbitrary progressive 
mesh representation M*^ 86 has a vertex Vs 88 and multiple adjacent faces (90-102). Vertex split 
transformation 82, parameterized as vspUt{v^, f^, f„„ f^, f^ ), determines a first set of pairwise 
adjacent faces {f^,, f„,} (96-98) and a second set of pairwise adjacent faces {f^, f^ } (100-102) 
associated with parent vertex Vj 88, In an illustrative embodiment of the present invention, the 
paurwise adjacent faces (i.e., a pair of adjacent faces) have a common border. However, other 
types of faces could also be used. In the illustrative example in FIG. 5, faces 96-98 and 100:^102 
were chosen as the sets of pairwise adjacent faces. However, other sets of pairwise adjacent faces 
could also be chosen (e.g.. (94,100) and (90,92)). Parent vertex Vj 88 is re-parameterized m 
progressive mesh representation M*^ 86 by replacing it with two child vertices v^ 104 and v^ 106 
and two new faces fL 108 and f^ 1 10. A first new face fL 108 is created between the first set of 
pakwise adjacent faces {f„o, f„i} (96,98). A second new face fR 110 is created between the second 
set of pairwise adjacent faces {f^, f^} (100,102). The two new faces fL 108 and fg 110 share new 
edge 112 which connects child vertices Vy 104 and v^ 106. A first re-parameterized progressive 
mesh representation M*^ 114 is formed by performing vertex split transformation 82 on the 
progressive mesh representation M*^ 86. Progressive mesh representation M** 86 can be recovered 
from re-parameterized progressive mesh representation M**^ 114 with a new constrained edge 
collapse transformation 84 described below. 

Vertex split transformation 82 is illustrated for a triangular progressive mesh 
representation M" with vertices {v,. Vj, Vj} as is shown in Table 1. 



FIG, 5 is a block diagram illustrating a constrained vertex split transformation 82 and 



wo 98/44445 



-n- 



PCTAJS98/06692 




TranQfhrmation on Mesh M'^ 


\/^Tfp^v f^nlif Trstnefnrmafinn ftO 
vciiCA oyiii 1 idiioivii iilallUii 


MUllVc V6rilC6S 




So={} 


M={Vi. V2, V3} 


IVI' ' 


V2- V4, V5 


M={Vi, V4. V5, V3} 


vtv ' 






Ivl* ' 


S3 = {So ,Si ,82} 


M={Vi, V4, Vg, V7, Ve, Vg} 






IVI - \Vto, V11, V4, V5, V7, 

Vs. Vg} 




S5 ~ {Sq iSi ,82 ,83 ,84} 


M = {Vio, V11, y4, Vs, V12. 

Vl3. Vs. V9} 


urn 


Se ~ {So .Si, 82 ,83 ,84 ,85} 
V10-V14, V,5 


M*={Vi4, V„, V11, V4,V6, 

V«.V«.Vb.V,} 



10 Table 1. 

For example, a first vertex split transformation s, splits vertex V2 into vertices V4 and 

V5, a second vertex split transformation Sj splits vertex Vj into vertices v^ and v,, etc. The initial 

coarser progressive mesh representation with vertices {vj, Vj, V3} and the final re-parameterized. 

progressive mesh representation with vertices {v,4, v,5, v,„ V4. v^, Vij, v,3, Vg, v,} are illustrated m 
15 FIG, 9. 

Edge collapse transformation 

Constrained edge collapse transformation 84. parameterized as ecol(y^, Vj, Vy, fL, f^, 

frt), f„„ f„2, fn3 )» performs the inverse transformation of vertex split transformation 82. Edge 

collapse transformation 84 transforms re-parameterized mesh representation M*^^ 114 back into 
20 mesh representation 86 by removing the two new faces f^^ 108 and f^ 1 10 and replacing child 

vertices v^ 104 and v^ 106 with parent vertex Vg 88. 

Edge collapse transformation 84 is illustrated for a re-parameterized triangular progressive mesh 
representation M" with vertices {v,4, V15, Vj,, V4. v^, Vjj, V13, Vg, V9} as is shown in Table 2. 
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Transformation on M^^M* 


Edge Collapse 
Transformation 


Acti^Wertices 


Mm 


66=0 


M*={V,4, Vi5, Vi„V4. Ve, 
V12. Vi3. Vb, Vg} 




65 ={66} 
Vl4. Vis - V10 


M = {V10. Vii, V4, V5, Vg. 
V12. Vi3, Vb, Vg} 


Mm 


64 = {66. 65} 
V,2, Vi3 - V7 


M = {v,o, v„, V4, V5, Vc. V7, 

Vs. V9} 




63 - {68. 65, 64} 
Vio. V11-V, 


M = {v,. V4. Vg, Ve, V7. Ve. 
V9} 


|V|(e2) 


62 = {65. 65. 64. 83} 
Va, V9 - V3 


M = {Vi, V4, Vg. Ve. V7, V3} 




61 ~ {66. 65, 64, 63, Bj} 

Ve. V7 - V5 


IVI ={Vi, V4,V5,V3} 


Mm 


®0 ~ {®6i ®5» ^4t ®3t ®2» ®l} 
V4. V5- Vj 


M={Vi, V2,V3} 



Table 2. 



As can be seen in Table 2, re-parameterized triangular progressive mesh 
representation can be collapsed back into a triangular progressive mesh representation M' with 
vertices {v,, Vj, Vj} using edge collapse transformation 84. Table 2 illustrates inverse of the 
transformations shown in Table 1. 

FIG. 6 is a block diagram illustrating a progressive mesh 1 16 with a boundary 118. 
A boundary may occur in the original progressive mesh representation. To support a progressive 
mesh representation M'^ 116 with a boundary 118, a first set of pairwise adjacent faces {f^, f„,} 
(96-98) or a second set of pairwise adjacent faces{ f„2, f^} (100,102) may not exist. For example 
in FIG. 6, pairwise adjacent faces for the set { f„2, f^} do not exist because of boundary 118, As 
a result, vertex split transformation 82 creates a single face fL 108 in a first re-parameterized 
boimdary progressive mesh representation M*^ 120 using only one set of pairwise adjacent faces 
(e.g., {fno, f„|} (96-98)) which exist in the mesh 116. Edge collapse transformation 84 removes 
single face fL 108 fi'om the first re-parameterized boundary progressive mesh representation 
120 to re-create the boundary progressive mesh representation 116. 
Method for constrained vertex split transformation 

Vertex split transformation 82 is constrained by active vertices and faces in a 
progressive mesh representation. FIG. 7 is a fiow diagram illustrating the steps of a method for 
vertex split transformation 82 illustrated in the block diagram in FIG. 5. A vertex is selected for 
splitting (e.g., vertex 88) at step 124. A check is done at step 126 to determine if the selected 
vertex is "active" in the progressive mesh representation. A vertex (or face) is "active" if it exists 
in the progressive mesh representation. If the selected vertex is not active at step 126, vertex 
split transformation 82 is not "legal" and cannot be inunediately completed. If the selected vertex is 
active at step 126, then a check is made to determine if a first set of pairwise adjacent faces {f„o, 
f„,}(e.g., 96,98) and a second set of pairwise adjacent faces {f^, f^} (e.g., 100,102) adjacent to 
the selective vertex are active at step 128. If the two sets of pairwise adjacent faces are not active 
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t^ll^formation 82 is not "legal** cannot be immediat^^lc 



at step 128, vertex split ^■Hformation 82 is not "legal** cannot be immediatel^bmpleted. If the 
first and second pairwise adjacent faces are active at step 128, then the selected vertex 88 is split 
into two child vertices (e.g., 104, 106) at step 130. A first new face (e.g., 108) is created between 
the first set of pairwise adjacent faces (96,98) with one edge (e.g., 112) connecting the two new 
S vertices (104,106) at step 132. A second new face (e.g., 1 10) is created between the second set of 
pairwise adjacent faces (100,102) with one edge 112 connecting the two new vertices (104,106) at 
step 134. The resulting re-parameterized mesh representation has the configuration which is 
illustrated in FIG. S by mesh 114. 
Method for constrained edge collapse transformation 

10 Edge collapse transformation 84 is also constrained by active vertices and faces in a 

progressive mesh representation. FIG. 8 is a flow diagram illustrating a method for edge collapse 
transformation 84 shown m FIG. S. A pan* of vertices (e.g., 104,106) are selected for collapsing at 
step 138. A check is done at step 140 to deterinine if the selected vertices are active in the re- 
parameterized progressive mesh representation M^^ 1 14. If the selected vertices (104, 106) are not 

15 active, the edge coUi^se is not "legal" edge collapse transformation 84 cannot be inunediately 

completed. If the two vertices are active at step 140, then a check is made at step 142 to determine 
if a first face f^^ and second face f^ (e.g. , 108, 1 10) are active and if a first and second set of faces 
(e.g., (96,98) (100,102)) pairwise adjacent to the first and second faces (108,110) are active, and if 
the first and second set of faces {f^, fo„ f^, f^} (96-102) are equal to faces a set effaces {f^, f„„ 

20 f„2> ^03} ^® re-parameterized progressive mesh representation M^^. In an illustrative 

embodiment of the present invention, the first and second faces (108,110) have a common edge 
(e.g., 112) which connect the two vertices (104,106) selected at step 138. The first set of faces 
(96,98) is pairwise adjacent to the first face 108 and the second set of faces (100,102) is pairwise 
adjacent to the second face 1 10 as is illustrated in FIG. 5. If the check at step 142 is false, the 

25 edge collapse is not "legal" edge collapse transformation 84 cannot be immediately completed. 

If the check at step 142 is true, then the two child vertices (104,106) are combined 
into one parent vertex 88 at step 144. The furst face 108 between the first set of pairwise adjacent 
faces (96,98) is removed at step 146. The second face 1 10 is removed at step 148. The resulting 
progressive mesh representation 86 has a configuration which is illustrated in FIG. S. 

30 Constraints on vertex split transformation and edge collapse transformation 

Vertex split transformation 82 and edge collapse transformation 84 are constrained by 
a set of constraints shown in Table 3. 



35 



An edge collapse transformation 84 is legal if 

1. Vertices Vj and are both active vertices; and 

2. Faces adjacent to and fp are faces.{fno, fm, fn2, W- 
A vertex split transformation 82 is legal If: 

1. Vertex is an active vertex; and 

2. Faces {f^, f^. f^, f^a} are all active faces. 



40 Table 3 
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r,^^^ or fewer constraints can also be used. The c^lj^i 



However or fewer constraints can also be used. The coSffaints shown in 
Table 3 determine how vertex split transformation 82 and edge collapse transformation 84 can be 
used to re-parameterize a progressive mesh representation. The constraints take into account active 
vertices and faces. 
5 Vertex hierarchy 

After a progressive mesh representation has been re-parameterized at step 72, a vertex 
hierarchy is constructed at step 74 with vertex split transformation 82 and information from the re- 
parameterized mesh M*^^. As is known in the art, vertex hierarchies have been used with vertex 
split operations and edge collapse operations to create simplification hierarchies that allow selective 

10 refinement of a mesh in real-time. For more information, see Dynamic View-Dependent 
Simplification for Polygonal Models^ by J. Xia and A. Varshney , IEEE Visualization'96 
Proceedings, pp. 327-334. 

Xia and Varshney precompute for a given triangular mesh M' a merge tree in a bottom up 
direction. All vertices V* are entered as leaves at level zero of the tree. Then, for each level / 

15 > = 0, a set of edge collapse operations is selected to merge pairs of vertices, and the resulting 
proper subset of vertices is promoted to level (/ + 1). The edge collapse operations in level / are 
chosen based on edge lengths, but with the constraint that their neighborhoods do not overlap. The 
topmost level of the tree (i.e., the forest) corresponds to the vertices of a coarse mesh M°. 

At run-time, selective refinement is achieved by moving a vertex front up and down 

20 through the merge tree hierarchy. For consistency of the refinement, an edge collapse operation or 
a vertex split operation is identical to that in the precomputed mesh at level /; these additional 
characteristics are stored m the merge tree. As a result, the representation shares characteristics of 
quadtree-type hierarchies in the respect that only gradual changes are permitted from regions of 
high refinement to regions of low refinement. 

2S Rather than restrictmg the construction of the vertex hierarchy based on edge lengths and 

constrain the hierarchy to a set of levels with non-overlapping transformations as is done by Xia 
and Varsheny, the vertex hierarchy is constructed from an arbitrary mesh by an optimized sequence 
of vertex split transformations 82 as to mtroduce as few dependencies as possible between the 
transformations. This minimizes the complexity of approximating meshes in an illustrative 

30 embodiment of the present of invention by using the constraints shown in Table 3. In addition, in 
an illustrative embodiment of the present invention, screen space approximation error is used which 
adapts mesh refinement to both surface curvature and viewing direction instead of just examining 
the ratio of an edge's length to its distance from the viewer as is done by Xia and Varshney. 

In an illustrative embodiment of the present invention , | V^ | and | F*^ | denote the 

3S number of vertices and faces in progressive mesh representation 86. Vertices and faces are 
numbered in the order that they are created in the vertex hierarchy at step 74 so that vertex split 
transformation 82 vsplitj introduces the vertices v,i = | V**| + 2i + 1, and v^j = | V**! + 2i + 2 
for a vertex v,| in the vertex hierarchy. For example, if i=0, and mesh has 3 vertices, then v,| 



wo 98/44445 PCTAJS98/06692 

-15- 



= 3 + (2*0) + 1=4 = 3 + (2*0) + 2 = 5. Vertices are re-parai!6rized (i.e.. v,i = 

V(i,v„;) as they are split, and this re-parameterization contributes to a small number refmement 
dependencies (e.g., child vertices Vj4,v„5 depend on parent vertex v,|). The vertex hierarchy is 
constructed in a top-down manner using a simple tree structure traversal of vertex split information 

5 which is stored in C+ + data structures described below (Table 4). However, other construction 
techniques may also be used. 

A vertex hierarchy in an illustrative embodiment of the present invention is created as 
a "forest" of unbalanced tree structures (i.e., not all leaves are at the same depth). A vertex 
hierarchy with unbalanced tree structures produces a selectively refined mesh with fewer levels 

10 than one using balanced tree structures as a result of few dependencies introduced in the vertex 
hierarchy. However, balanced tree strucuures could also be used. A vertex hierarchy for a set of 
vertices which include parent vertices v^i and child vertices v^ and v„j which form a forest of tree 
structures in which root nodes are the vertices of a coarsest mesh (e.g., base mesh = M^) and 
leaf nodes (are the vertices of a most refined mesh (e.g., original arbitrary mesh = M**). 

IS FIG. 9 is a block diagram illustratmg a vertex hierarchy ISO. In an illustrative 

example in FIG. 9, three root vertices v, , Vj , and Vj (152-1S6) form a "forest" of root xiodes for a 
progressive mesh rispresentation M*^ = M^1S8 (e.g., a triangle). Vertex Vj 1S4 has been split into 
two child vertices by vertex split transformation 82 and are numbered V4 and V5 (168-170) 
respectively (i.e.. 3+(2*0)+l =4, 3+(2*0)+2=5). Vertex Vj 170 has m turn been split mto two 

20 child vertices v^ 172 and v^ 174 by vertex split transformation 82 and are numbered v« and V7 

(i.e., 3+(2*l)+l =6, 3+(2*l)+2=7). Vertex split transformation 82 is repeated for vertices V3, 
Vjo, and V7 (1S6, 160, 174). A most refined mesh 184 (i.e., an origmai mesh M'=M"=M^) is 
formed from leaf node vertices (164, 166, 162, 168, 172, 176, 178, 180, 182) in vertex hierarchy 
ISO where M' is an arbitrary triangular progressive mesh representation. 

2S In an illustrative embodiment of the present invention re-parameterized mesh M*^ is 

adaptively refined at step 80 using a "vertex front" through the vertex hierarchy ISO based on 
changing view-dependent parameters. A vertex front corresponds to one mesh approximation that 
is created using vertex split transformations 82 and edge collapse transformations 84 based on 
changing view-dependent parameters. 

30 Data structures 

Table 4 shows C+ + data structures used for the N-data structure records for a 
progressive mesh representation an illustrative embodiment of the present invention. A re- 
parameterized mesh created at step 72 (FIG. 4) comprises an array of vertices and an array of faces 
which are stored using the data structures in Table 4. A vertex hierarchy created at step 74 (FIG. 

3S 4) also uses the data structures shown in Table 4. Only selected ones of the vertices and faces are 
actiye at any one time in a selectively refined progressive mesh. Active vertices and faces are 
specified with two doubly-linked lists that thread through a subset of N-data structure records 
comprising the progressive mesh sequence. However, other list structures could also be used. 
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struct ListNc 
ListNode *next; 
ListNode *prev; 

}; 

struct Vertex { 

ListNode active; 
Point point; 
Vector normal; 
Vertex* parent; 
Vertex* vt; 



//Node possibly on a doubly-nRR^d list 
7/0 if this node is not on the list 



//list stringing active vertices V 



110 if this vertex is in M° 
110 If this vertex is in M'^ 
//(vu==vt+1), so no storage field 
//The remaining fields encode vsplit information, defined if vt!=0 



Face* fl; 
Face* fnI4]; 
Refinelnfb refine info; 

}; 

struct Face { 
ListNode active; 
Vertex* vertices[3]; 
Face* neighbors[3]; 
int matid; 

}; 

struct SRMesh { 
Array<Vertex> vertices; 
Array<Face> faces; 
ListNode active_vertices; 
ListNode active_faces; 

}; 



//{fr==fl+1). so no storage field 
//required face neighbors fn0,fn1,fn2,fn3 



//list stringing active faces 
//ordered counter-clockwise 
//neighbors[i] across from verticesp] 
//material identifier 



//Selectively refinable mesh 
//set of all vertices V 
//set F'^ of all faces 
//head of list Vc V 
//head of list F c F'^ 



35 



40 



45 



Table 4 

The Vertex data structure in Table 4 uses the fields parent and vt to encode a parent vertex v. and a 
child vertex v, from the vertex hierarchy 150 shown in FIG. 9. If a parent vertex can be split with 
vertex split transformation 82, the^Z and)»i[4] fields (i.e., for {f^, f^i^f^, f„3 } ) encode the 
remaming parameters of vertex split transformation 82. Since fR=fL+ 1> and v,=Vu+ 1 in the 
vertex hierarchy, there are no fields in the Vertex data structure for f^ or v„ as these values can be 
quickly calculated. 

The Face data structure contains links to active faces with the field active, current 
vertices in the face with the field vertices[3], Imks to its current face neighbors with the field 
neighbors[3]. A material identifier mor/i/ is used for rendering. The data structure 5KM£f A is used 
to store a selectively refined mesh and is used to store the output from an ad^tively refined mesh 
created at step 80 (FIG. 4). 
View-dependent parameters 

In an illustrative embodiment of the present invention, a set of selective refinement 
criteria are used to refine a progressive mesh representation. The set of selective refmement 
criteria include view-dependent parameters. The view-dependent parameters include a view 
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g^Bl), a surface orientation,, and a screen space ge^Hiii 



frustum (i.e., a viewingiBe), a surface orientation,, and a screen space geoRRuric error. 
However, more or fewer view-dependent parameters can be used, and each of tlie view-dependent 
parameters can be used individually (e.g., use only the view frustum, use only the surface 
orientation, etc.). When one or more of the view-dependent parameters changes at step 78 (e.g., a 

5 region of the re-parameterized progressive mesh M^^ representation is now oriented towards a 

viewer) the re-parameterized progressive mesh representation M^^ is adaptively refined to contain a 
different level-of-detail. 
Selectively refinement criteria 

FIG. 10 is a flow diagram illustratmg method 186 to determine if vertex in a re- 

10 parameterized mesh M*^^ should be split or collapsed based on view-dependent selective refinement 
criteria. Method 186 (FIG. 10) is used to determme whether a vertex should be split using vertex 
split transformation 82 or coarsened using edge collapse transformation 84 based on the changed 
view-dependent parameters. Method 186 uses three view-dependent criteria to determine whether a 
vertex should be splh or coarsened: a view frustum, a surface orientation, and a screen-space 

IS geometric error. However, more or fewer view-dependent parameters could also be used. One or 
more of the view-dependent parameters may also be used individually. 

A first test is done at step 188 to determine if a vertex affects a graphical object 
within the view fiustum. If the vertex does not affect the graphical object within the view frustum, 
dien it is not split. If the vertex does affect the graphical object within the view frustum, then a 

20 second test is completed at step 190. At step 190, if the vertex is not oriented towards a viewpoint, 
then the vertex is not split. If the vertex is oriented towards a viewpoint, then a third test is 
completed at step 192. If a screen-space error calculated for the vertex exceeds a pre-determined 
tolerance, then the progressive mesh representation containing the vertex should be refined at step 
194. If a screen-space error calculated for the vertex does not exceed a pre-determined tolerance at 

25 step 192, then the two child vertices of the current vertex are candidates to be collapsed into the 

current vertex at step 196. Table S shows pseudo-code for a sub-routme to implement method 184. 
However, other view-dependent selective refinement criteria could also be used for method 186 and 
the subroutine shown in Table S. 



30 



35 



function qrefine(V) //FIG. 10 

//Refine if vertex V affects the surface within a view frustum, step 188 

if outside_view_frustum{V) return false 
//Refine if part of the affected surface for the vertex faces a viewpoint, step 190 

if oriented_away(V) return false 
//Refine if screen-space projected error exceeds pre-determined tolerance t, step 192 

if screen_space_error(V) <= tolerance t return false 
return true 

end function qrefine 



Table 5 

40 View frustum 

FIG. 11 is a flow diagram illustrating in more detail step 188 of FIG. 10. A method 
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198 is shown for deter^^g if a vertex V is within a view frustum. 

Method 198 (FIG. 11) determines if a vertex V is within a view frustum using a 
boundmg space hierarchy after a mesh representation of an arbitrary progressive mesh 
representation M' is loaded into memory system 16 of computer system 10. For a vertex v' € V 
5 (e.g., the leaf nodes of vertex hierarchy 150 for M' 183) a first set of spheres Sv- with radii r^. that 
bound a set vertices adjacent to v' is determined at step 200. However, the bounding sphere could 
be replaced by other bounding elements (e.g., axis aligned boxes). A postorder traversal of vertex 
hierarchy 150 is performed at step 202 to create a second set of spheres with radii r^ for the set 
of vertices Vj m the vertex hierarchy. As is known in the art, in a postorder traversal, any root 

10 node in a hierarchy is processed after its descendants. The postorder traversal in step 202 starts 
with the vertices v" € V (i.e., the leaf nodes). However, other traversals of the vertex hierarchy 
could also be used. The postorder traversal assigns a parent vertex v,, in the vertex hierarchy the 
smallest sphere S„i with radius r„i that bounds the spheres S^j and S^^ of its children v, and v„. 
Since the resulting spheres are not centered on the vertices Vj, a third set of larger spheres 

15 centered at vertex V that bounds the second set of sphere is determined at step 204 by finding 
radii r^, for the vertices V| In an alternative embodiment at the present invention, all decedent 
vertices could be considered to construct a bounding volimie for a given node. This approach is* 
slower in terms of computational time but is more precise. In an illustrative embodiment of the 
present invention, steps 200-204 are completed as pre-processing steps. In an alternative 

20 embodiment of the present invention steps 200-204 are completed at run-time. 

In an illustrative embodiment of the present invention, the view frustum is a 4-sided 
(i.e., semi-mfinite) pyramid which is known in the graphics art. At run-time, a test is conducted to 
determine if sphere of radius r^ centered at vertex 

V=(VxiVy lies outside the view frustum at step 206 using the test shown in equation 3. 
25 a, + b,Vy + CjV^ + d| < (-rj for any i = 1 . . .4 (3) 

The four linear functions aj v^ -h b|Vy -h CjV^ + d^ in equation 3 measure the signed Euclidean 
distance to one of the four sides of the view frustum from vertex V, However, other fractions and 
other view frustum shapes could also be used. If a bounding sphere Sl with radius Tl lies 
completely outside the view frustum, then the region of the mesh M* that possibly could be affected 

30 by the split of vertex V lies outside the view fiiistum and is not split . If the region of the mesh M* 
that possibly could be affected by the split of vertex V lies outside the view frustum, then the vertex 
is still a candidate for splitting at step 208 and the test at step 190 (FIG, 10) is performed to 
determine if the vertex V should be split. 

FIG. 12 is a block diagram which shows an illustrative bounding space hierarchy 210 

35 for method 198 (FIG. 11). A vertex V 212 and a two-dimensional view of a view frustum 214 are 
shown with a portion of a vertex hierarchy with parent vertices v., 216 and v,2 218, child vertices 
v„, v^ and v^j (220,222,224,226). Using method 198 on FIG. 11, for a vertex v" € V (216, 
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(228,230) with radii Xy- that bound a set veitice^S4 



218) a first set of sphere^^(228,230) with radii Tv- that bound a set vertice^54,226) adjacent to 
V* in the vertex hierarchy is determmed at step 200 (FIG. 11). A postorder traversal of the vertex 
hierarchy beginning with leaf nodes (220,222) at step 202 (FIG. 1 1) assigns a parent vertex v^j 216 
in the vertex hierarchy the smallest sphere S^^, 232 with radius rv,i that bounds the spheres Svti and 
5 S^i (228,230) of its children v. and v„ (220,222). Since the resulting second set of spheres 232. 
one of which is show in FIG. 12, is not centered on vertex V 212 a third set of larger spheres Sl is 
created. One sphere 234 from the third set of larger spheres is illustrated in FIG. 12 centered at 
vertex V 212 that bounds the second set of spheres 8^232. Sphere 234 is determined at step 204 
(FIG. 1 1) by finding radii r^ for the vertex V 212. 

10 In FIG. 12, two of the four Imear functions aj v, + bjVy + CjV, + d} (equation 3) for the 

test at step 204 (FIG. 11) are used to measure the signed Euclidean distances (236, 238) to two 
sides of the view fiiistum 214 are illustrated in FIG. 12. The Euclidean distances (236, 238) are 
both less than (-rj 240 for bounding sphere 8^234. Thus, vertex V 212 lies outside the view 
frustum 214 and is not split. If Vertex V 212 was within the view frustum 214, then the test at step 

IS 190 (FIG. 10) is conducted to test for surface orientation. 
Surface orientation 

FIGS. 13A-13C are block diagrams which help illustrate step 190 (FIG. 10), which 
tests the orientation of a vertex with respect to a viewpoint. FIG. 13A illustrates the region of a 
surface of mesh M' 242 affected by a vertex V| 244 and normal vector n'^i 246. FIG. 13B 

20 illustrates a region of a three-dimensional graphical image 248 (e.g., a graphical terrain, a 

subsection of M' which mesh M' 242 affects. FIG. 13C illustrates a Gauss map 250 of mesh 242. 
As is known in the computer graphics arts a Gauss map is a mapping from a group of points on a 
surface of a graphical object to a group of points on a unit sphere. 

The test at step 190 in FIG. 10 is analogous to the test at step 200 in FIG. 1 1 except 

25 that a set of space normals 252 (FIG. 13C) over a surface defined by Gauss map 250 is used 

instead of the graphical image surface 248 itself. The set space of normals 252 is a subset of a unit 
sphere S^ 254 where S^ = { p e : | |p| | = 1}, and p is a set of points corresponding to a 
normal of a triangle face of an arbitrary triangle mesh M* and is a linear map. 

For a vertex Vj 244, a region of M' 248 defines the space of normals 252 supported 

30 by vertex V| 244 and its descendants in vertex hierarchy 150. A cone of normals 256 is defined by 
a semiangle a^i 258 about vector n\, 246. The semiangle a^^lSS is computed after a progressive 
mesh is loaded into memory system 16 of computer system 10 using a "normal space hierarchy." A 
sphere S'vi 260 bounds the associated space of normals 252. A viewpoint e 262 is used to view the 
vertex v, 244. If the viewpoint e 262 lies in a backfacing region 264 of vertex Vj 244, no part of the 

35 affected surface region is oriented toward the viewpoint. 

FIG. 14 is a flow diagram illustrating in more detail step 190 of FIG. 10 for 
determining surface orientation. At step 268 in method 266 (FIG. 14), a sphere S'vi 260 (FIG. 
13C) is determined for a normal from a face of M' 248 that bounds an associated space of normals 
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A 9 
Sphere could be replaced by other bounding elefflent: 



252. However, the boii^Pg sphere could be replaced by other bounding elelRents (e.g., axis 
aligned boxes). At step 270, semiangle a^i 258 of bounding cone 256 about vector n\i 246 that 
bounds the intersection of S'yj 260 and 254 is determined. If no bounding cone 256 with 
semiangle a^; < n/2 exists at step 272, semiangle 258 is set to n/2 at step 274 (i.e., n = 

5 3.1415927...). In an illustrative embodiment of the present invention steps 268-274 are completed 
as pre-processing steps. However, in an alternative embodiment of the present invention, steps 
268-274 are completed at run-time. Given a viewpoint e 262, it is unnecessary to split vertex v^ 
244 if vertex v^ lies in a backfacing region 264 of a e 262. In the prior art, the test shown in 
equation 4 is commonly used as a backfacing test. 

10 (a,, - e)/(||a,i - e||) • nV > sin a,, (4) 

In equation 4, a^j is a cone anchor point that takes mto account the geometric bounding volume of 

. The difference between cone anchor point a^j and the viewpoint e 262 is divided by the 
magnimde of their vector difference. As is known in the art, the magnitude of a vector difference 

1 1 v| I , for V =(x. y, z) = ^Ji^^'^y^^^^) is a vector that is used to take the dot product with 

15 vector n\) 246. As is known in art, the combination of ABcosB in which A and B are the 

magnimdes of two vectors, and 6 is the angle between them, is the scalar product or dot product of 
A and B. Thus, the dot product of A and B = A • B = A^ Bx + Ay By + Az B^ = E; Aj B^. If 
the dot product value in equation 4 is greater than the sine of the semiangle a^^ 258, then vertex v, 
244 lies m the backfacing region 264 for viewpoint e 242 and is not split. 

20 In an illustrative embodiment of the present invention, the cone anchor point a^j is 

approximated by vertex v, 244 (i.e., a parallel projection z^proximation) and the test shown in 
equation 5 is used instead as a backfacing test at step 276 at run-time. 

(Vi - e) • nV> 0 and ((v, - e) • nV)^ > ||vr e\f sin^ a,-. (5) 

The test shown in equation 5 used at step 190 improves time and space efficiency over the 
25 prior art backfacing test shown in equation 4. A vector difference between vertex Vj 244 and 

viewpoint e 262 is determined. The vector (Vj - e) is then used to take the dot product with vector 
n',! 246. 

If this first dot product is greater than zero (i.e., (v^ - e) • n^j > 0), then a second 
test is conducted. In the second test, the first dot product squared is used to determine if the 

30 quantiQr is greater than the square of the magnitude of the vector difference between vertex V} 244 
and viewpoint e 242 multiplied by the square of the sine of semiangle a^} 258. If both the first and 
second tests are true at step 276, then venex v, 244 lies in the backfacing region 264 and is not 
visible to from viewpoint e 262. A vertex Vj 244 that is not visible to the viewpoint e 262 is not 
split. If either the first or second tests are false at step 276, then vertex Vj 244 does not lie in 

35 backfacing region 264 and is visible to from viewpoint e 262. Vertex V; 244 is oriented towards 
viewpoint e 262 at step 278 (FIG. 14) and is still a candidate for splitting at step 192 of FIG. 10. 
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Screen-space geometri^BlDr 

Step 192 in FIG. 10 is used to test if a screen space error exceeds a pre-determined 
tolerance. For vertices v e V, a measure of the deviation between v and its current neighborhood 
Ny (i.e., the set of faces adjacent to v) and a corresponding neighborhood region N\ in M' is 

S determmed. One quantitative measure is the Hausdorff distance H(Ny, N\) defined as the least 
scalar r for which (N^ c N\ e B(r)) and (N\ c e B(r)) where B(r) is the closed baU of radius 
r and the operator e is the Minkowski sum. The Mmkowski sum e is defined asAeB = {a + b 
: a e A, b € B}. If ff(Ny, N\) = r, the screen space distance between neighborhood Ny and 
neighborhood N\ is bounded by die screen-space projection of B(r). The Hausdorff distance and 

10 Minkowski sum are known to those skilled in the art. 

If neighborhood and neighborhood N\ are similar and approximately planar, a 
tighter distance bound can be obtained by replacing B(r) by a more general deviation space D. For 
example, deviation of height fields (i.e., graphs of the xy-plane) are recorded by associatmg to a set 
of vertices a scalar value 6 representing a deviation space D^.(6) = { hz' : -6 < = h < = 6}. The 

IS main advantage of using Dj^^(6) is that its screen-space projection vanishes as its principal axis z 

becomes parallel to the viewing direction, unlike the corresponding B(5). For more information on 
the derivation of D^.(6) see Real-time, Continuous Level of Detail Rendering of Height Fields, by 
P. Lmdstrom, et. al, ACM SIGGRAPH*96, pp. 109-118. 

In an illustrative embodiment of the present invention, 0^.(5) is generalized to 

20 arbitrary surfaces. FIGS. ISA-ISB are block diagrams illustrating a new screen space geometric 
error representation. A new derivation space J^^^{iifi) is defined. FIG. ISA is an illustration of 
deviation space D„.(fi,5) 280. FIG. 15B is an illustration of the cross-section 282 of FIG. 14A. 

Most of the deviation space D„.0i,5) 280 is orthogonal to a surface and is captured by 
a du-ectional component 5n' from a scalar component 5 284, but a uniform.component /x 286 may 

25 be required when surface neighborhood li\ 288 is curved. Uniform component /i 286 also allows 
accurate approximation of discontinuity curves (e.g., surface boundaries and material boundaries) 
whose deviations are often tangent to the surface. In an illustrative embodiment of the present 
mvention, D„.(/i,6) 280 corresponds to the shape whose projected radius along a view direction v" 
is expressed as MAX(/i, 6 1 |n' x v** 1 1). That is, D„*(^,6) 280 is the maximum of two values, the 

30 uniform component ii 286, or the scalar component 5 284 multiplied by the magnitude of the vector 
difference of the cross product of normal vector n'^ 246 and radius direction v**. As is known in 
the art, the cross product A x B is a vector with magmtude ABsinO . The magnitude of the cross 
product I |AxB| I = ABsinO. 

FIG. 16 is a flow diagram for method 290 for finding deviation space D„^(fA^,6^) at 

3S vertices v e V. After edge collapse transformations 84 are applied, the deviation between 

neighborhoods N„ and N"„ is determined by examining the residual error vectors E = { Cj } from a 
dense (i.e., closely related) set of points X, sampled on region M' 248 that locally project onto 
at step 292. The smallest deviation space D„-(/Av,5y) with the ratio 6^ lii^ that bounds E is 




wo 98/44445 PCT/US98/06692 

-22- 



determined at step 294 ^^^AX,,,^{g, • N*,) / MAX,j,e | | Cj x N* J | . ThlWi; the ratio bjfi^is 
fixed and the deviation space D„.(fty,6^) is determined by finding the maximmn residual error e^ of 
the dot product of the vector e, and the vector for neighborhood N\, divided by maxinmiri residual 
error e, of the magnitude of cross product of the vector e, and the vector for neighborhood N\, 
5 However, other simplification schemes could also be used to obtain deviation spaces with 
guaranteed bounds. 

Given a viewpoint e 262, a screen space tolerance t (i.e. , as a fraction of the 
viewpoint size) and a field of view angle q, a determination can be made if the screen space 
projection D„.(fty,6J exceeds screen space tolerance r with the test shown in equation 6. 
10 MAX(Mv,6, II n; X ( (v-e) / ||v-e|| ) || ) / 1| v-e || >= ( 2 cot ? / 2) t (6) 

If the maximum of /iy, and the large expression with 5y is greater than or equal to two times the 
cotangent of the view angle q/2 times the screen space tolerance x, then D^^ifi^fi^) exceeds screen 
space tolerance t. 

In an illustrative embodiment of the present invention, steps 292-294 are 
IS completed as pre-processing steps. In an alternative embodiment of the present invention, steps 
292-294 are completed at run-time. 

In an illustrative embodiment of the present invention, an equivalent test shown in 
equation 7 is used at step 296 to determine if the screen space projection D^^(ji^,6^) exceeds screen 
space tolerance t . 

20 m'v >= ||v - e||2 OR 5^ (|| v - e \\' - (( v - e) • n;)^ ) >= /c^ || v - e|r (7) 

where Ic^ = (2 cot q/lf and is a new view angle factor that is computed once per 
frame. A fu-st test determines if a square of the umform component ft is greater than or equal to 
the square of the k component times the square of the magnitude of the vector difference between 
vertex v and viewpoint e. If this first test is true, then D„.(^y,6y) exceeds screen space tolerance t. 

25 If the first test is false, a second test determines if the square of the scalar component 5 multiplied 
by the square of the absolute value of the vector difference between vertex v and viewpoint e 
squared, minus the dot product of the vector difference between vertex v and viewpoint e and the 
vector for neighborhood N\ squared, is greater than or equal to the k componem squared 
multiplied by the absolute value of the vector difference between vertex v and viewpoint e raised to 

30 the fourth power. If so, then D„«0ty,5y) exceeds screen space tolerance t. 

If neither part of the test in equation 7 evaluates to true at step 296, the screen space 
geometric error does not exceed the screen space tolerance t, so the progressive mesh is not 
adaptively refined. If either part of the test at step 296 evaluates to true, then at step 298, die 
vertex is still a candidate for splitting. 

35 In an illustrative embodiment of the present invention, the steps of method 186 in 

FIG. 10 are completed in the following order: step i^O; step 192; and then step 188 to make 
method 186 an optimal method. However, other orders for the test can also be used. Since all 
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id^pb-expressions, the tests completed in method ISmBquii 



three tests share commd^pb-expressions, the tests completed in method iSmiquire less than 15% 
of time used to render a frame on the average in an embodiment of the present invention. The 
scalar values { -r^, sin^ay, 6% } computed at step 76 (FIG. 4) with method 290 (FIG. 16) are 
stored in a data structure record in a v.refinejnfo field (Table 2) for easy access. 
S Adaptively refining a mesli 

To refine a re-parameterized mesh to create an adaptively refined mesh at step 80 
(FIG. 4) after the three tests of method 186 (FIG. 10) based on changed view-dependent parameters 
at step 78 (FIG. 4) a method for adaptively refinmg a mesh is used. An active list of vertices V is 
traversed before rendering a frame. For vertices v e V a decision is made to leave the vertex as is, 

10 split it with vertex split transformation 82, or collapse it with edge collapse transformation 84. To 
adaptively refine a mesh, multiple vertex split transformation 82 and multiple edge collapse 
transformations 84 may take place before the desired vertices and faces are active and a desired 
refined mesh can be created. 

FIGS. 17A and 17B are flow diagrams illustrating method 302 for adaptively refining 

IS a mesh. At step 304 (FIG. 17A), a loop is used to iterate through a list of doubly linked list of 

active vertices V (e.g., v.active from Table 4) for a re-parameterized mesh M'^ based on changed 
view-dependent parameters. The adaptively refined mesh is stored m the data structure SRMesh 
shown in Table 4. At step 306 a test is conducted to determme if an active vertex v^ should be 
refined on the changes in view-dependent parameters. The test used to determine if the active 

20 vertex should be split is described by method 186 (FIG. 10) and the pseudo-code in Table 5. 
However other tests could also be used. If the test at step 306 evaluates to true, then a test is 
conducted at step 308 to determme if vertex split transformation 82 performed on active vertex v, is 
"legal." Vertex split transformation 82 is legal if the vertex (e.g., 88 stored m v.parent ) and a first 
and second set of pairwise adjacent faces (e.g., (96-102) stored in v.fri[0..3J) adjacent to vertex 88 

25 are active. If any of the faces are not active (i.e. , not currently included in the mesh), then a series 
of vertex spilt transformations 82 are performed at step 310 to make the vertex split transformation 
at step 308 legal. The series of vertex split transformations 82 at step 310 are done to change any 
required inactive faces (e.g., in the set v.fti[0„3J) mto active faces. If the vertex split at step 310 is 
legal, then the sibling of active vertex v^ is also active, so active vertex v^ is split at step 312 into 

30 two child vertices with vertex split transformation 82. 

If the test at step 306 fails, a test is conducted to determine if an edge collapse 
transformation 84 of the parent of active vertex v^ is legal at step 314 (FIG. 17B). Edge collapse 
transformation 84 is performed only if it is legal (i.e., the parent of v^ is also active and the 
neighbormg faces of v.parent.fl and v.parent.fr match those in v.parent.jh[0. . JJ). If the test at 

35 step 314 fails, nothing is done to active vertex v^. 

A test is performed at step .316 (FIG. 17B) to determine if flie parent of active vertex 
V, should be refined based on the changes in view dependent parameters. If the test at step 316 
evaluates to false then the active vertex v^ is collapsed with edge collapse transformation 84 at step 
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318. If the test at step ^^^aluates to false, then refinement of the parent Wrotive vertex is 

completed (FIG. 17A). Table 6 shows pseudo-code for sub-routines to implement method 302 in 

an illustrative embodiment of the present invention. 

5 procedure aclapt_refinement{) //FIG. 17 

for v€ V 

if v.vt and qrefine(v) // Tables 4 & 5 
force_vsplit(v) 

else if v.parent and ecoljegal(v.parent) and not qrefine(v. parent) // Tables 4 & 5 
10 ecoKv.parent) // FIGS, 5 & 8, 84 

end procedure adapt_refinement() 

procedure force_split(v') 
stack - 

15 while V - stack.topO 

if v.vt and v.fl e F 

stack, pop // V was split earlier in the loop 
else if V € V //not active 
stack.push(v.parent) 
20 else if vsplitjegal(v) 

stack.popO 

vsplit(v) // FIGS. 5 & 7. 82 
else for i e { 0...3} 
if v.fn[i] f F 

25 // force vsplit that creates face v.fn[i] 

stack.push(v.fn[i].vertices[0].parent 
end procedure force_split(v') 

Tables 

The procedure force jplit () uses a stack to store vertices for a vertex that is split 

30 with vertex split transformation 82. However, other data structures could also be used. 

Method 302 (FIG. 17) adaptively refmes an area of a mesh (e.g., with vertex split 
transformation 82) based on changed view-dependent parameters, and coarsens an area of a mesh 
(e.g., with edge collapse transformation 84) when possible. After a vertex split transformation 82 
or edge collapse transformation 84 is performed, some vertices in the resulting area may be 

35 considered for further transformations. Since these vertices may have been previously visited m 
the transversal of V, the vertices are relocated in the list of vertices to reside inunediately after the 
list iterator. For example, after a vertex split transformation 82, v,vt is added to the list of vertices 
after the iterator. After an edge collapse transformation 89, v,parent is added and v.vZ and v. vr are 
relocated after the iterator. 

40 The time complexity for method 302 for transft)rming M'^ into is 0(|V^| + 

I I) in the worse case since M^-M°-M^could require 0(| V^|) edge collapse transformations 84 
and 0( I I ) vertex split transformations 82 each taking constant time. The set of vertices is 
similar to the set of vertices V^. As is known in the art, 0(f(n)) notation is used to express the 
asymptotic complexity of the growth rate of a function f(n). For continuous view-dependent 

45 changes, a simple transversal of the active vertices | V | is 0(| V |), which is the time consuming 
portion of method 302. Note the number of active vertices | V | is typically much larger than the 
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er^^^ V* I . However, the rendering process, which ^^^1] 



number of original verf^^ V | . However, the rendering process, which ^^ally has time 
complexity 0( | F | = 2 1 V | ). has a larger time constant than 0( | V | ), where | F | is the nmnber of 
active faces. Thus, method 302 requires only about 14% of the total tune used to render a frame 
on the average in an illustrative embodiment of the present invention for a given computer system 
5 configuration (e.g., with a Silicon Graphics Indigo! Extreme, 150 MHz R4400 with 128 MB of 
memory). 

For a given mesh and a constant screen-space tolerance t , the nimiber of active faces 
I F I can vary dramatically depending on the view. Smce both refinement times and rendering times 
are closely correlated to | F | , this leads to high variability in frame rates. In an illustrative 
10 embodiment of the present invention, screen-space tolerance t is regulated so as to maintain |F| at 
a nearly constant level. 

If m is the desired number of faces, and method 302 is called at time-t, then the 
formula in equation 8 is used to regulate screen-space error x. 

Tt = TM(|FM|/m) (8) 

15 The quantity | F,., | is the number of active faces in the previously drawn frame. This simple 

feedback control system using equation 8 exhibits good stability since | F | is a smooth monotonic 
function of x. In an alternative embodiment of the present invention, direct regulation of the frame 
rate could be used, but since frame rate is more sensitive to operatmg system inconsistencies, frame 
regulation may be achieved indirectly using a secondary, slower controller by adjusting m in 

20 equation 8. 

Since step 304 m method 302 (FIG. 17) is a simple traversal of the entire list V, the 
work accomplished by method 302 can be distributed over consecutive frames with amortization by 
traversing only a subset of the list V in a frame. For slowly changing view-dependent parameters 
amortizing method 302 reduces the already low overhead of adaptive refinement at step 80 while 

25 introducing few visual artifacts. 

However, with amortization, regulation of | F | through the adjustment of screen- 
space tolerance x becomes more difficult since the response in | F | may lag several frames. In an 
Dlustrative embodiment of the present invention with amortization, only a subset of the entire list V 
is traversed each frame instead of the entire list V. Thus, the adjustment work for screen-space 

30 tolerance x is distributed over one or more consecutive frames. Changes are not made to the 

screen-space tolerance x until the entire list V has been traversed. To reduce overshooting, vertex 
split transformation 82 is not allowed if the number of active faces reaches an upper limit (e.g., 
I F I > = 1 .2m), but the number of faces that would be introduced towards the next adjustment of x 
are coimted. 

35 Geomorphs 

Method 302 also supports geomorphs between any two selectively refined meshes M'' 
and M^ A geomorph mesh M^(a) is a mesh whose vertices vary as a function of a parameter 0 
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thi^^(0) looks identical to and M^(l) look identiil^ 



< = a < = 1, such th£l^P(0) looks identical to and M^(l) look identiHRb M^. A geomorph 
mesh M°(a) is found whose active vertex front is lower than or equal to that of and M^for 
every vertex in the vertex front. FIG. 18 is a block diagram illustrating a vertex hierarchy 320 for 
a geomorph mesh M°(a) 322 that is lower than or equal to meshes 324 and 326. The 
S individual vertices (lSO-182) for the meshes were described for FIG. 9 above. 

Mesh M' trivially satisfies this property (see M'=M'^ 184, FIG. 9). However, a 
simpler geomorph mesh M°has a property that its faces F^ are a superset of both F'^ and F®, and 
that any vertex Vj e V° has a unique ancestor Vpc^^Qj e and a unique ancestor Vpo^^^) e V°. 
Geomorph mesh M^(a) 308 is the mesh (F*^. V°(a)) with the relationship shown in equation 9. 

10 yj''(a) = (1 - a)VpG.A(j) + (a)VpG,Ba) (9) 

When is the result of method 302 on M^, geomorph mesh M° can be obtained 
more directly. Instead of a smgle pass through V at step 304, two distinct passes are completed 
through V. 

FIG. 19 is a flow diagram illustrating a method 328 for directly creating a geomorph 
15 mesh M^(a) A first pass - M^(a) is completed using method 302 (FIG. 17) where only vertex 
split transforms 82 are considered at step 330. The sequence of vertex split transformations 82 is 
recorded at step 332. A second pass M°(a)- is completed where only edge collapse transforms 
84 are considered at step 334. The sequence of vertex, split transformations 82 is recorded at step 
336. For both passes, the sequence of transformations (82,84) are recorded (332,334) allowing a 
20 backtracking through the transformations to recover the intermediate mesh M^(a), and to construct 
desired ancestry functions p°"^ and p^^^. The resulting geomorph M°(a) is used to provide a 
smooth transition between meshes and M^. The smooth transition helps eliminate jerky or 
abrupt transitions called "popping" when the meshes are viewed. 
Triangle Strips 

25 Many graphics systems create triangle strip representations of graphical images for 

optimal rendering performance. A triangle strip is a sequence of connected triangles with adjacent 
faces. FIG. 20 is a block diagram of a graphical terrain 338 illustrating a triangle strip 340. 
Triangle strip 340 has a starting point at face 342 and an ending point at face 344. The triangle 
strip is created with a clockwise spiral. When a graphical image is rendered, triangles strips are 

30 used to render and display connected areas within the graphical image efficiently. 

In an illustrative embodiment of the present invention, the refinement method 302 
(FIG. 17) is incremental. As a result, it is not easy to precompute triangle strip (340) shown in 
FIG. 20. FIG. 21 is a flow diagram illustrating a method 3S0 for generating triangle strips in an 
illustrative embodiment of the present invention for changed view-dependent parameters and is used 

35 with method 302. Method 350 produces triangle strips with a length of 10-15 faces per strip for 
efficient rendering. 

At step 352, a list of active faces / e F is traversed. A test is conducted at step 354 
to determine if a face /(e.g., 344) has not yet been rendered. If face /has been rendered, then a 
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^t^^d« If face /has not yet been rendered, then a^l^r 



new triangle strip is not^^ed* If face /has not yet been rendered, then a SPrtriangle strip (e.g., 
340) is started at step 356 for face/. Face /is rendered at step 358. A test is conducted at step 360 
to determine if any of the faces adjacent to the face / have not been rendered. If an adjacent face 
has not been rendered, it is rendered at step 362 and added to the triangle strip. Adjacent faces 

S with similar characteristics are considered so a triangle strip which does not cause changes to the 
graphics state of the graphics hardware is created. 

To reduce fragmentation, the triangle strip 340 is built in a clockwise spiral (e.g., 
342 to 344) in an illustrative embodiment of the present invention. In an alternative embodiment of 
the present invention, a counter-clockwise spiral (e.g., 344 to 342) is used for the triangle strip 

10 340. When the test at step 360 fails (i.e., all adjacent faces have been rendered), the triangle strip 
has reached a dead end (e.g., 344), and the traversal of the list of faces F at step 354 resumes at a 
new face (e.g., 346). One bit of the Face.nuuid field (Table 2) is used as a boolean flag to record 
rendered faces. The rendered face bits are quickly cleared with a second pass through F when all 
faces have been rendered. 

15 Parametric Surfaces 

In an illustrative embodiment of the present invention real-time adaptive tessellation 
of parametric surfaces is used. As is known in the art, tessellation is the process of triangulating a 
smooth surface with the texture, color and shadowing. FIG. 22 is a flow diagram illustrating a 
method 364 for adaptive tessellation of parametric surfaces. Method 364 is completed as a pre- 

20 computation in an illustrative embodiment of the present invention. In an alternative embodiment 
of the present mvention, method 364 is completed in real-time. At step 366 a dense tessellation 
mesh (i.e., detailed) of a surface of a graphical object is computed. The dense tessellation mesh 
includes approximations of the texture, shading, and color of vertices, edge, and faces of the 
graphical model. At step 368, the dense tessellation mesh is used to construct a progressive mesh 

25 sequence. At step 370, the progressive mesh sequence is truncated to a desired level of detail. At 
run-time, the truncated progressive mesh sequence is refined at steps 78-80 of FIG. 4 according to 
a viewpoint e 262 based on a set of changing view-dependent parameters. 

Although the tessellation is fixed prior to run-time, the run-time implementation 
requires no tessellation trinuning or stitching, is efficient since an incremental refmement is used 

30 (e.g., method 302) and is highly adaptable for tessellations whose connectivities adapt to both 
surface curvature and to the viewpoint. 
. Adaptive refinement system 

FIGS. 23 A and 23B are block diagrams illustrating a system 372 for an illustrative 
embodiment of the present invention. The system 372 includes a locator/constructor module 374 

35 which locates N-data structure records for an arbitrary progressive mesh representation M* . In. an 
alternative embodiment of the present invention, loader/constructor module 374 constructs the N- 
data structure records for arbitrary progressive mesh representation M* in memory system 16 of 
computer system 10. A pre-processing module 376 is used to load the progressive mesh 



wo 98/44445 



PCT/US98/06692 



-28- 



rq)resentation in memo] 



Item 16 of computer system 10, re-parameteri 




progressive mesh 



10 



15 



20 



25 



30 



representation and pre-processes the progressive mesh representation using a set of selective 
refinement criteria (72-76, FIG, 4). To adaptively refine the arbitrary progressive mesh M* at run- 
time, a renderer module 376 receives view-dependent parameters, evaluates selective refinement 
criteria, adaptively refines mesh, and renders active faces on a display device for a user (78-80, 
FIG. 4). The renderer modiile can be any combination of hardware and software known in the art 
which is used to render a graphical image. In an illustrative embodiment of the present invention, 
an Indigo! Extreme (e.g., a 150 MHz, R4400 with 128 MB of memory) graphics system by Silicon 
Graphics of Mountain View, California is used as renderer module 378. However, other renderers 
could also be used. The locator/constructor module 374 and the pre-processing module 376 are 
implemented as software application programs in the Silicon Graphics system. However, other 
configurations could also be used. More or fewer modules could also be used for system 372, and 
the functionaliQ^ of modules 374-378 can be split into additional modules, combined into fewer 
modules, and used at pre-progressing or at run-time. FIG. 23B is a block diagram illustrating the 
details for system 372 described above. 
Additional iliiistrations of the present invention 

Additional illustrations of methods and system an illustrative embodiment of the present 
invention are shown in FIGS. 24-27. FIGS. 24-27 are color illustrations of various aspects of the 
current invention. FIG. 3 was explained above. 

FIGS. 24A-F are color screen displays 380-390 of a view-dependent refinement of a 
progressive mesh representation. In FIGS. 24A-24B a two dimensional view frustum is higihlighted 
in orange and a pre-detemimed screen-space geometric error x is used to display a graphical 
terrain. FIG. 24A is a color screen display 380 of a top view of progressive mesh representation of 
a graphical terrain where the screen-space geometric error tolerance x is 0.0% and there are 33,119 
faces. This screen display shows a veiy high level of detail within the view frustum. The view 
frusmm is shown as the orange "V" pointing towards the top of the figure. FIG. 24B is a color 
screen display 382 of a top view of the progressive mesh representation of FIG. 24A where the 
screen-space geometric error tolerance t is now 0.33% and there are 10,013 faces. FIG. 24B has 
been adaptively refined with method 70 (FIG. 4). FIG. 24C is a color screen display of a regular 
view 384 of the progressive mesh representation of FIG. 24A adaptively refined with method 70 of 
FIG. 4. The progressive mesh representation within the view frustum in FIG. 24 has been 
coarsened and contain a lesser level of detail in FIGS. 24B and 24C. Method 70 (FIG. 4) can be 
used with the progressive mesh representation in FIG. 24B and 24C to create the progressive mesh 
in FIG, 24A by adaptively refining the meshes in FIGS. 24B and 24C. 

FIG. 24D is a color screen display 386 of a texture mapped progressive mesh 
representation M' with 79,202 faces. FIQ, 24E is a color screen display 388 of a texture mapped 
progressive mesh M' with 10,103 faces. As can be seen in FIGS. 24D and 24E, there is almost no 
perceptual difference between the figures even though FIG. 24E has significantly fewer faces (e.g., 
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imi^^ith method 70). FIG. 24F is a color screen di^fl^: 



FIG. 24E was approximi^p^ith method 70). FIG. 24F is a color screen diipi^ 390 of the 
triangle strips (yellow lines) which generated from the meshes in FIGS. 24D and 24E. FIGS 24B, 
24C, 24D and 24E have a screen-space geometric error x of 0,33% which represents 2 pixels for a 
600x600 pixel graphical image. FIG. 24F shows the creation of triangle strips which have similar 
5 characteristics. For example, the dark brown portion of the surface in FIGS. 24D and 24E (upper 
right comer) correspond to triangle strips in the upper right comer of FIG. 24F. 

FIGS. 2SA-2SC are color screen displays 392-396 which illusUrate view-dependent 
refinement using method 70 (FIG. 4) for a sphere. FIG. 25A is a color screen display 392 of an 
original tessellated sphere with 19,800 faces. FIG. 2SB is a color screen display 394 of a front 

10 view of the tessellated sphere shown in FIG. 2SA created with method 70. FIG. 2SC is a color 
screen display 396 of a top view of the coarsened tessellated sphere from FIG. 2SB. As can be 
seen in FIG, 25B, the sphere looks very similar to the origmal sphere shown in FIG, 25A. A two- 
dimensional view frusmm is shown with an orange "V." The backfacing portion of the sphere is 
coarse compared to the forward facing portion of the sphere nearest the "V" in the view frustum 

IS which is more refined. 

FIGS. 26A-26C are color screen displays 398-402 illustrating view-dependent refinement 
of a truncated progressive mesh representation (10,000 faces) created with a tessellated parametric 
surface usmg method 364 (FIG. 22). FIG. 26A is a color screen display 398 of an original 
tessellated graphical image (i.e., a portion of a tea pot) with 25,440 faces. FIG. 26B is a color 

20 screen display 400 of a truncated progressive mesh representation of a progressive mesh sequence 
with T = 0,15% and 1,782 faces. FIG. 26C is a color screen display 402 showing a top view of 
the truncated progressive mesh in FIG. 26B. A two-dimensional view frustum is illustrated by the 
yellow "V." The coarsenmg of regions outside the view frustum can be observed to the right of the 
view frustum. 

25 FIGS. 27A-27C are color screen displays 404-408 illustrating two view-dependent 

refinements of an arbitrary mesh for a graphical character with method 70. FIG. 27A is a 
color screen display 404 of the original arbitrary mesh representing a graphical character with 
42,712 faces. FIG. 27B is a color screen display 406 of a first coarsened progressive mesh with 
3,157 faces. The view frustum used is illustrated by the yellow box around the graphical 

30 characters head in FIG. 27B. Parts of the graphical figure outside the view frustum have been 
coarsened and appear as general shapes with less defined detail and are represented by coarsened 
meshes. The view frustum in FIG. 27C is illustrated by the yellow box around a hand of the 
graphical character. View-dependent parameters (e.g., the view fmstum) have been changed 
between FIGS. 27B and 27C. The mesh representing the head of the graphical character has been 

35 coarsened as shown near the top of FIG. 27C. The hand, knee and top portion of the boot within 
the view frustum have been refined with method 70 between FIGS. 27B and 27C to show 
increased level of detail since these areas now appear within the view frustum. 
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If M is the set of all possible meshes, a progressive mesh representation M**^ of a mesh 
M, where M e M, and M***^ c M defines a continuous sequence of mesh approximations M' for i 

= {0, ..Mn-1), M°, M' M""' of increasing accuracy from which view-independent level-of- 

detail approximations of any desired complexity can be efficiently retrieved. A view-independent 
progressive mesh representation M**^ is created for a mesh M with a first set of mesh 
transformations, a first set of constramts on the set of mesh transformations and a set of fixed 
refinement criteria. The first set of mesh transformations used to create a progressive mesh 
representation include edge collapse operation 36 and vertex split operation 38 (FIG. 2). The edge 
collapse operation 36 and vertex split operation 38 are vertex-based operations. The first set of 
mesh transformations is constrained by a set of constraints is shown in Table 7. 

An edge collapse operation 36 eco/(Vs, Vl, Vr, Vj) is legal if: 

1. Vertices Vg and are both active vertices, and 

2. faces {Vg, Vt, V,} and {v„ v^, are active faces. (FIG. 2) 
A vertex split operation 38 vspW(Vs, Vl, Vr) is legal if: 

1 . Vertex Vg is an active vertex, and 

2. vertices v, and Vr are active vertices. (FIG. 2) 



An initial mesh M*" can be simplified mto a coarser mesh by applying a sequence of n- 
1-successive edge collapse operations 36 using the constraints in Table 7 and the set of fixed 
refinement criteria. The set of fixed refinement criteria includes placing all candidates for edge 
collapse 36 into a priority queue, where the priority of each transformation is its energy cost AE. 
The energy cost AE accurately fits a set X of points Xj e with a small nmnber of vertices from 
the initial mesh M" into a mesh M' in the progressive mesh representation. 

When edge collapse operation 36 is to be performed, the edge collapse operation at the 
front of the priority queue (i.e., with the smallest AE) is completed and the priorities of edges in 
the neighborhood of the edge collapse operation a recomputed and placed in the priority queue. 
For more information see the Progressive Meshes paper cited above. The set of fixed refinement 
criteria allows intermediate mesh approximations M' to be created for a progressive mesh 
representation M***^ of mesh M. Since edge collapse operations 36 are invertible, a coarser mesh 
M° together with a sequence of n-successive vertex split operations 38, can be used to re-create 
initial mesh M". 

Method 70 (FIG, 4) and the other methods described above for an illustrative embodiment 
of the present invention are used to adapiively refine an arbitrary triangle mesh M", where M* c 
M, and M* is stored as a progressive mesh representation. An adaptively refined mesh is 
created from arbitrary triangle mesh M using a second set of constramts on a second set of mesh 
transformations, and a set of selective refinement criteria. The second set of refinement criteria is 
used manipulate different portions of the arbitrary mesh M with different mesh transformations. 
In an illustrative embodiment of the present invention, die second set of refinement criteria are used 
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transformations include vertex split transformations 82 and edge collapse transformations 84. The 
constraints in Table 8 below allow vertex split transformations 82 and edge collapse transformations 
84 to be applied out of sequence (i.e., not in the rigid total order imposed by the edge collapse 
operations 36 and vertex split operations 38 for a progressive mesh representation) and consider 
faces. The second set of mesh transformations (82,84) are used to build a vertex hierarchy (e.g., 
ISO, FIG. 9) used to adaptively refine an arbitrary mesh. The second set of constramts on the 
second set of mesh transformations used in an illustrative embodiment of the present invention are 
shown m Table 8 below. 

An edge collapse transformation 84 eco/(Vs, Vy, Vy. ft. fp, fno. fm. fn2. U ) is legal if: 

1 . Vertices and are both active vertices, and 

2. faces adjacent to fL and fp are feces {fno, fni, fn2. W (P'G- 5). 
A vertex split transformation 82 vsp//f(Vs, fno, fni. fn2. ^na ) is legal if: 

1 . Vertex v^ is an active vertex, and 

2. faces {fpo, f^i, f^g. W are all active faces (FIG. 5). 



The set of selective refinement criteria are based on the view-dependent parameters (Table 
4, FIG. 10) which include the view frustum, the surface orientation, and a screen space projected 
error. The set of selective refinement criteria are different than the set fixed refinement criteria 
discussed above. The set of selective refinement criteria allows asymmetric transformations with 
varying levels of refinement on a mesh (i.e. , areas of a mesh can be refined with vertex split 
transformations 82 while other areas of the same mesh can be coarsened with edge collapse 
transformations 84). In contrast, the set of fixed refinement criteria allows only uniform 
transformations with a fixed level of refinement on a mesh (i.e., a series of edge collapse 
transformations 36 to move from M'"^^ to M', or a series of vertex split transformations 38 to move 
from M' to M'"^^). The set of selective refinement criteria also allow an arbitrary subsequence of 
vertex split transformations 82 and edge collapse transformations 84 to be applied to a base mesh to 
create an adaptively refined mesh. However, the present invention is not limited to the second set 
of constraints on the second set of mesh transformations and the set of selective refinement criteria 
in the illustrative embodiment described above. 

In a generalized embodiment of the present invention, a general framework is used for 
incrementally adapting any arbitrary mesh which includes an arbitrary set of constraints on an 
arbitrary set of mesh transformations and an arbitrary set of selective refinement criteria. For 
example, the arbitrary set of mesh transformations may constrain mesh transformations other than 
vertex split transformation 82 and edge collapse transformation 84. The arbitrary set of constraints 
on the arbitrary set of mesh transformations may include more or fewer constraints than those 
shown in Table 8 above. The arbitrary set of selective refinement criteria may include criteria 
other than changes in view-dependent criteria such as time-variant parameters and surface-focused 
parameters. Time-variant parameters provide the ability to focus on different parts of the same 
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graphical image to illuminate the portion) » Surface-focused parameters provide the ability to 
display different information on portions of a surface in a graphical image (e.g., temperature 
variation over a surface displayed graphically), 

FIG. 28 is flow diagram illustrating a generalized method 410 for adaptively refining an 
arbitrary mesh with an arbitrary set of constraints on an arbitrary set of mesh transformations and 
an arbitrary set of selective refinement criteria. At step 412 an arbitrary mesh is selected. The 
arbitrary mesh can be any mesh from the set of meshes M. The arbitrary mesh is stored as a 
progressive mesh representation. However, other mesh representations could also be used. A set 
of constraints for a set of mesh transformations for the arbitrary mesh is selected at step 414. A set 
of selective refinement criteria for the arbitrary mesh is selected at step 416. The selective 
refinement criteria allow varying levels of refinement within the mesh (i.e., refining and coarseiiing 
different areas of the mesh same instance of a representation). The refmement of the arbitrary 
mesh is adjusted at step 418 using the set of constramts for the mesh transformations and the set of 
refinement criteria and adds geometric primitives to the arbitrary mesh thereby creating a first 
appro?dmation of a selectively refined mesh. The selective refined mesh is adaptively refined by 
navigating through the selective refined mesh at step 420 based on changes affecting the refinement 
criteria to create an adj^tively refined mesh. For example navigation is completed with a vertex 
front through a vertex hierarchy created for the mesh and provides varymg levels of refinement 
within the mesh. 

The view-dependent refinement of meshes (method 70, (FIG. 4) etc.) described above is 
one specific example of an arbitrary mesh adaptively refined with generalized method 410. For 
example, an arbitrary triangle mesh M* e Mis selected at step 412. The arbitrary triangle mesh M' 
is stored as a progressive mesh representation, M°,..,, M""\ M" = M". A set of constraints (e.g., 
Table 8) for a set of mesh transformations (e.g., vertex split transformation 82 and edge collapse 
transformation 84) are selected at step 414. A set of selective refinement criteria (e.g., changing 
view-dependent parameters (FIG. 10)) is selected at step 406. The refinement of the mesh is 
adjusted at step 418 usmg the set of constraints and the set of refinement criteria to create a first 
approximation of a selectively refined mesh (e.g., steps 72-76, FIG. 4, Table 5). The selective 
refined mesh is adaptively refined by navigating through the selectively refined mesh at step 410 
based on changes affecting the refinement criteria (e.g., steps 78-80, FIG. 4, Table 6) to create an 
adaptively refined mesh. 

Generalized method 410 can be used on an arbitrary mesh by replacing selected 
components described for an illustrative embodiment of the present invention. A new set of mesh 
transformations can be selected by replacing the vertex split 82 and edge coUs^se 84 
transformations with new mesh transformations. A new set constraints can replace die constraints 
shown in Table 8 (which may also result in a new vertex hierarchy construction). A new set of 
selective refinement criteria can be selected (e.g., by replacing the view-dependent parameter 
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5wl^^sub-routine shown in Table 5) . A new methoJMT n 



function calls the ^r^^iwl^^sub-routine shown in Table 5) . A new metho^w navigating through 
the selectively refine mesh can also be selected (e.g., by replacing the adaptjrefinmentQ sub- 
routine shown in Table 6). 

Generalized method 410 creates an adaptively refmed mesh with varying levels of 
S refinement from an arbitrary mesh stored as a progressive mesh sequence that can be used with 
almost any underlying geometric model used to display a graphical image. The resulting adaptively 
refined mesh that requires fewer polygons for a desked level of approximation than other 
refinement schemes known in the art. As a result of adaptive refinement a reduction in the number 
of polygons is achieved by coarsening regions of the mesh that are not visible by a viewer under 
10 selected view conditions which allows the graphical image to be rendered using fewer computer 
resources. Adaptively refined meshes can be also used to for progressive transmission of a mesh 
over a computer network like the Internet or an mtranet for an image used in a computer game or 
other application. 

It should be understood that the programs, processes, and methods described herein 
IS are not related or limited to any particular type of computer apparatus (hardware or software), 
unless indicated otherwise. Various types of general purpose or specialized computer apparatus 
may be used with or perform operations in accordance with the teachings described herein. 

In view of the wide variety of embodiments to which the principles of my invention 
can be applied, it should be understood that the illustrated embodunents are exemplary only, and 
20 should not be taken as limitmg the scope of my invention. For example, the steps of the flow 

diagrams may be taken in sequences other than those described, and the clauns should not be read 
as limited to the described order unless stated to that effect. Therefore, I claim as my invention all 
such embodunents as come withm the scope and spirit of the following claims and equivalents 
thereto. 
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1. A computer executed method for adaptively refming an arbitrary first mesh used to 
approximate a geometric model, the method comprising the following steps: 
S selecting a set of mesh transformations constrained by a set of constramts; 

selecting a set of selective refmement criteria; 

adjusting the refinement of the first mesh using the constrained set of mesh transformations 
and the set of selective refmement criteria to add geometric primitives to the first mesh thereby 
creating a first approximation of a selectively refmed mesh; 
10 receiving an mdication that one or more of the selective refmement criteria have changed; 

and 

adaptively refming the first approximation of the selectively refmed mesh by navigating 
through the selectively refmed mesh to create an adaptively refmed mesh. 



IS 2. A computer-readable storage medium having stored therein instructions for causing a 

computer to execute the steps of the method of claim 1. 

3. The method of claim 1 further comprismg: 

constructing a progressive mesh representation of the first mesh in a memory of a 
20 computer system; and 

creating N-data structiu^ records associated with the progressive mesh representation, 
where the N-data structure records include vertices, faces and edges from the first mesh. 

4. The method of claim 1 wherein the set of mesh transformations include a vertex split 
25 transformation and an edge collapse transformation. 

5. The method of claim 4 wherein the set of constraints on the set of mesh 
transformations includes constraints on a vertex and a set faces pairwise adjacent to the vertex ft-om 
the furst mesh which are transformed by the vertex split transformation. 

30 

6. The method of claim 4 wherein the set of constraints on the set of mesh 
transformations includes constraints on set of two vertices, a first face with an edge connecting the 
two vertices, a second face with an edge connecting the two vertices and a set of faces pairwise 
adjacent to the two vertices and the first and second faces from the first mesh which are 

3S transformed by the edge collapse transformation. 



7. The method of claim 1 wherein the set of selective refmement criteria include view- 
dependent selective refinement criteria. 
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8. The method im 1 wherein the set of selective refinement c^^l include other 
than view-dependent selective refinement criteria. 

9. The method of claim 1 wherein the step of adjusting the refinement of the first mesh 

S includes: 

re-parameterizing the first mesh to create a re-parameterized selectively refined mesh; 

and 

constructing a vertex hierarchy for vertices in the re-parameterized selectively refined 

mesh. 

10. The method of claim 1 wherein the step of adaptively refining the first approximation 
of the selectively refined mesh mcludes: 

refining a first area of the selectively refined mesh; and 
coarsening a second area of the selectively refined mesh. 

1 L The method of claim 1 wherein navigating through the selectively refined mesh 
includes moving a vertex front througlh a vertex hierarchy created fi-om vertices in the selectively 
refined mesh. 



10 



15 



20 12. The method of claim 1 wherein the step of adaptively refining the first approxmation 

of the selectively refined mesh includes providing varying levels of refinement within the adaptively 
refined mesh. 

13. The method of claim 1 wherein the step of adaptively refining the first approximation 
25 of the selectively refined mesh includes regulating the number of faces rendered for the adaptively 

refined mesh using changes to the selective refinement criteria. 

14. The method of claim 1 wherem the step adaptively refining the first approximation of 
the selectively refined mesh includes rendering a pre-determined number of active faces for the 

30 adaptively refined mesh to a display device. 

15. A computer executed method for adaptively approximating an arbitrary first mesh, 
where the first mesh is stored in a memory of a computer system as a progressive mesh 
representation, the method comprising the following stq)s: 

35 adjusting the refinement of the progressive mesh representation for the first mesh using a 

constrained set of mesh transformations and a first set of selective refinement criteria to add 
geometric primitives to the progressive mesh representation thereby creating a first approximation 
of a selectively refined mesh; and 
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[e first approximation of the selectively refined 




by navigating 



through the selectively refined mesh using a second set of selective refinement criteria to create an 
adaptively refined mesh, thereby providing varying levels of refmement within the adaptively 
refined mesh. 



16. A computer-readable storage medium having stored therein instructions for causing a 
computer to execute the steps of the method of claim IS. 

17. The method of claim 15 wherein the step of adjusting the refmement of the 

10 progressive mesh representation includes using the first set of selective refinement criteria to pre- 
process the progressive mesh representation to re-parameterize the progressive mesh representation 
and create a vertex hierarchy for the progressive mesh representation. 

18. The method of claim IS wherein the step of adaptively refining the first 

IS approximation of the selectively refmed mesh includes using the secoiul set of selective refinement 
criteria to process the first approximation of the selectively refmed mesh at run-time to provide . 
varying levels of refmement within the adaptively refined mesh. 

19. The method of claim IS wherein providing varying levels of refinement within the 
20 adaptively refmed mesh includes providing at least one refined area in the adaptively refined mesh, 

and at least one coarsened area in the adaptively refined mesh. 

20. A system for adaptively refining an arbitrary first mesh using a set of constrained 
mesh transformations and a set of selective refmement criteria, the system comprising: 

2S means for constructmg a progressive mesh representation for the first mesh; 

means for pre-processmg the progressive mesh representation for the first mesh 
using the constrained mesh transformations and a subset of the selective refinement criteria; and 

means for rendering an adaptively refined mesh to a display device using another 
subset of the selective refinement criteria. 



S 



wo 98/44445 



PCTAJS98/06692 



1/41 



FIG. 1 



16 



COMPUTER 12 



MEMORY SYSTEM 




MAIN 






MEMORY 




\ 


30 




SECONDARY 






STORAGE 




^ 


32 



22 



CPU 



24 



ALU 



26 



14 



10 



REGISTERS 



28 



CONTROL 
UNIT 



22 



22 



r 



18 



INPUT 
DEVICE 

(KEYBOARD, 
POINTING 
DEVICE, 
MODEM,. 
NETWORK 
CONNECTION, 
ETC.) 



OUTPUT 
DEVICE 

(DISPLAY, 
PRINTER, 
MODEM, 
NETWORK 
CONNECTION, 
ETC.) 



20 



IT" 



SUBSTITUTE SHEET (RULE 26) 



wo 98/44445 



PCT/US98/06692 




SUBSTITUTE SHEET (RULE 26) 



wo 98/44445 



PCT/US98/06692 





wo 98/44445 



PCTAJS98/06692 



FIG. 3C 





wo 98/44445 



PCT/US98/06692 



5/41 



FIG. 4 



C 



START 



70 



RE-PARAMETERIZE A PROGRESSIVE 
MESH REPRESENTATION TO CREATE A 
RE-PARAMETERIZE MESH 



72 



CONSTRUCT A VERTEX HIERARCHY 
FROM THE RE-PARAMERTIZED 
PROGRESSIVE MESH REPRESENTATION 



I 



74 



PERFORM PREPROCESSING FOR FASTER 
RUN-TIME EVALUATION OF SELECTIVE 
REFINEMENT CRITERIA 



I 



76 



PRE-PROCESSING 
RUN-TIME 



RECEIVE AN INDICATION THAT VIEW- 
DEPENDENT PARAMETERS HAVE 
CHANGED 



78 



ADAPTIVELY REFINE THE RE- 
PARAMETERIZED MESH BASED ON THE 
CHANGED VIEW-DEPENDENT 
PARAMETERS USING THE VERTEX 
HIERARCHY AND PRE-COMPUTED 
SELECTIVE REFINEMENT CRITERIA TO 
CREATE AN ADAPTIVELY REFINED MESH 



80 



wo 98/44445 



PCT/US98/06692 




SUBSTITUTE SHEET (RULE 26) 



M'O 98/44445 



PCTAJS98/06692 



7/41 



FIG. 7 



C 



START 



82 



SELECT A VERTEX FOR SPLITTING WITH 
THE VERTEX SPLIT TRANSFORMATION 



124 




SPLIT SELECTED "PARENT" VERTEX 
INTO TWO "CHILD" VERTICES 



130 



CREATE A FIRST NEW FACE BETWEEN 
THE FIRST SET OF PAIRWISE ADJACENT 
FACES WITH ONE EDGE CONNECTING 
THE TWO CHILD VERTICES 



I 



C 



END 



132 



CREATE A SECOND NEW FACE BETWEEN 
THE SECOND SET OF PAIRWISE 
ADJACENT FACES WITH ONE EDGE 
CONNECTING THE TWO CHILD VERTICES 



134 



3 



SUBSTITUTE SHEET (RULE 26^ 



wo 98/44445 



PCTAJS98/06692 



FIG. 8 



8/41 



START 



3 



84 



SELECT TWO VERTICES CONNECTED 
WITH AN EDGE FOR COLLAPSING WITH 
THE EDGE COLLAPSE TRANSFORMATION 



138 



140 




COMBINE THE TWO CHILD VERTICES 
INTO ONE PARENT VERTEX 



I 



144 



REMOVE THE FACE F^ BETWEEN THE 
FIRST SET OF PAIRWISE ADJACENT 
FACES {F^o'Pni) 



REMOVE THE SECOND FACE F^ 
BETWEEN THE SECOND SET OF 
PAIRWISE ADJACENT FACES {Fn2,Fn3} 



-146 



148 



SUBSTITUTE SHEET (RULE 26) 



wo 98/44445 



PCT/US98/06692 




SUBSTITinrE SHEET (RULE 26) 



wo 98/44445 



PCT/US98/06692 



10/41 



FIG. 10 




YES 



THE TWO CHILD 
VERTICES OF THE 
CURRENT VERTEX ARE 

CANDIDATES TO BE 
COLLAPSED INTO THE 
CURRENT VERTEX 



VERTEX SHOULD BE REFINED 



194 



SUBSTITUTE SHEET (RULE 26) 



wo 98/44445 



PCT/US98/06692 



11/41 



FIG. 11 



C 



START 



198 



FOR VERTICES IN DETERMINE A 
RADIUS Ry« SPHERE S^^ THAT BOUNDS A 
SET OF VERTICES ADJACENT TO A 
VERTEX V 



n 

200 



PERFORM A TRAVERSAL OF VERTICES V, IN A VERTEX 
HIERARCHY TO ASSIGN A PARENT VERTEX Vg THE SMALLEST 
SPHERE Svs WITH RADIUS R^ THAT BOUNDS THE SPHERES 
SvT AND SjjT OF ITS CHILDREN V,. AND V^ 



n 

202 



FOR VERTICES V, IN THE VERTEX HIERARCHY 
FIND LARGER SPHERE S^ CENTERED AT VERTEX V 
WITH RADIUS Rl THAT BOUNDS S^g 



204 



PRE-PROCESSING 
RUN-TIME 



YES-i 




VERTEX V IS WITHIN VIEW FRUSTUM AND 
IS STILL A CANDIDATE FOR SPLITTING 



^ 208 




SUBSTrrUTE SHEET (RULE 26^ 



wo 98/44445 



PCT/US98«)66M 




SUBSTITUTE SHEET (RULE 26) 



wo 98/44445 



PCTAJS98/06692 




Ri iRjrrm itp rhfft muLE 26^ 



wo 98/44445 



PCTAJS98/06692 



14/41 



FIG. 14 



C 



START 



3 



266 



DETERMINE A SPHERE S'^ THAT 
BOUNDS AN ASSOCIATED SPACE OF 
NORMALS FOR NORMALS OF FACES OF 
M'^ AFFECTED BY THE SPLIT OF V, AND 
ITS DESCENDANTS 



268 



DETERMINE A SEMIANGLE ALPHA^, OF A 
CONE ABOUT VECTOR N^, THAT BOUNDS 
THE INTERSECTION OF S'^, AND S' 



270 



■272 



BOUNDING CONE WITH 
ALPHA^i < Pi/2 EXIST? 



YES- 




VERTEX V, IS ORIENTED TOWARDS A 
VIEWPOINT AND IS STILL A CANDIDATE 
FOR SPLITTING 



wo 98/44445 



PCT/US98/06692 



15/41 



FIG. 15A 




FIG. 15B 



wo 98/44445 



PCT/US98/06692 



16/41 



FIG. 16 




C 



START 



3 



290 



DETERMINE THE DEVIATION BETWEEN 
N^s AND W'yf^ BY EXAMINING THE 

RESIDUAL ERROR VECTORS E = { E, } 
FROM A DENSE SET OF POINTS X 
SAMPLED ON M* THAT LOCALLY 
PROJECT ONTO N^s 



n 

292 




VERTEX IS STILL A CANDIDATE FOR 
SPLITTING 



wo 98/44445 



PCTAJS98/06692 



FIG. 17 



f 



17/41 



PRE-PROCESSING 



302 



RUN-TIME 





YES- 



PERFORM A SERIES OF VERTEX SPLIT 
TRANSFORMATIONS TO MAKE VERTEX V^ 
SPLIT LEGAL 



SPLIT ACTIVE VERTEX V^ 


312 









310 



wo 98/44445 



PCTAJS98/06692 



18/41 



FIG. 17B 




PERFORM AN EDGE COLLAPSE 
TRANSFORMATION ON ACTIVE VERTEX 



318 



NO h 



YES- 



TOB 
.FIG.17Ai 



wo 98/44445 



PCTAJS98/06692 




wo 98/44445 



PCTAJS98/06692 



20/41 



FIG. 19 



C 



START 



3 



328 



FOR VERTICES V IN V\ COMPLETE 
MA -> MG CONSIDERING ONLY VERTEX 
SPLIT TRANSFORMATIONS 



330 



RECORD SEQUENCE OF VERTEX SPLIT 
TRANSFORMATIONS 



332 



FOR VERTICES V IN V", COMPLETE 
M<3 -> M^ CONSIDERING ONLY EDGE 
COLLAPSE TRANSFORMATIONS 



n 

334 



RECORD SEQUENCE OF EDGE 
COLLAPSE TRANSFORMATIONS 



n 

336 



END 



wo 98/44445 PCT/US98/06692 

21/41 



FIG. 20 




344 



wo 98/44445 



PCTAJS98/06692 



22/41 



FIG. 21 



352 




350 



-YES- 



354 



-YES- 



BEGIN A NEW TRIANGLE 
STRIP WITH FACE f 



356 



RENDER FACE f 



358 




1 



ADD AN 
ADJACENT 
FACEfaTO 
TRIANGLE 
STRIP, RENDER 
FACE f,, SET 
f = f- 



362 



wo 98/44445 



PCTAJS98/06692 



23/41 




FIG. 22 



C 



START 



3 



364 



COMPUTE DENSE TESSELLATION MESH 
FOR A SURFACE IN A GRAPHICAL IMAGE 



n 

366 



CONSTRUCT A PROGRESSIVE MESH 
REPRESENTATION FROM THE DENSE 
TESSELLATION MESH 



368 



TRUNCATE THE PROGRESSIVE MESH 
REPRESENTATION TO A DESIRED LEVEL 
OF DETAIL 



n 

370 



PREjfROCEJSING 
RUN-TIME 



wo 98/44445 



PCT/US98/06692 



24/41 



FIG. 23A 



372 



LOCATOR/CONSTRUCTOR 
MODULE 



h 

374 





PRE-PROCESSING MODULE 


376 






PRE-PROCESSING 
RUN-TIME 




RENDERER 
MODULE 


^378 



wo 98/44445 



PCTAJS98/06692 



25/41 



FIG. 23B 



ARBITRARY MESH M"" 



372 



LOCATOR/CONSTRUCTOR 
MODULE 

(CONSTRUCT PROGRESSIVE MESH 
REPRESENTATION) 



PROGRESSIVE MESH 
REPRESENTATION 



374 



PRE-PROCESSING MODULE 
(LOAD PROGRESSIVE MESH 
REPRESENTATION INTO MEMORY, 
RE-PARAMETERTIZE PROGRESSIVE 
MESH REPRESENTATION. 
PERFORM PRE-PROCESSING ON 
SELECTIVE REFINEMENT CRITERIA ) 



376 



PRE-PROCESSING 



RUN-TIME 



RENDERER MODULE 
(RECEIVE VIEW-DEPENDENT 
PARAMETERS, EVALUATE SELECTIVE 
REFINEMENT CRITERIA, 
ADAPTIVELY REFINE MESH, 
RENDER ACTIVE FACES) 



378 



wo 98/44445 



PCT/US98/06692 




wo 98/44445 



PCT/US98/06692 




wo 98/44445 



PCTAJS98/06692 



FIG. 24D 



29/41 





wo 98/44445 PCT/US98/06692 

30/41 



FIG. 24E 



wo 98/44445 PCTAJS98/06692 

32/41 



FIG. 25A 



• 



wo 98/44445 



PCTAJS98/06692 




wo 98/44445 



PCT/US98/06692 



FIG.25C ^ • 



wo 98/44445 PCT/US98/06692 




wo 98/44445 



PCT/US98/06692 




wo 98/44445 PCTAJS98/06692 

37/41 



FIG. 26C 



wo 98/44445 . PCT/US98/06692 




wo 98/44445 PCTAJS98/06692 




wo 98/44445 



PCT/US98/06692 



41 /41 

FIG. 28 



START 



410 



SELECT AN ARBITRARY PROGRESSIVE 
MESH REPRESENTATION 



412 



SELECT A SET OF MESH 
TRANSFORMATIONS AND A SET OF 
CONSTRAINTS ON THE SET OF MESH 
TRANSFORMATIONS 



414 



SELECT A SET OF SELECTIVE 
REFINEMENT CRITERIA 



n 

416 



ADJUST THE REFINEMENT OF THE 
PROGRESSIVE MESH REPRESENTATION 
USING THE SET OF CONSTRAINED MESH 
TRANSFORMATIONS AND THE SET OF 
SELECTIVE REFINEMENT CRITERIA TO 
CREATE A FIRST APPROXIMATION OF A 
SELECTIVELY REFINED MESH 



I 



I ilRE-EROCESSING 

: ▼ . RUN-TIME 



418 



ADAPTIVELY REFINE THE SELECTIVELY 

REFINED MESH BY NAVIGATING 
THROUGH THE SELECTIVELY REFINED 
MESH 



r 



420 



This Page is Inserted by IFW Indexing and Scanning 
Operations and is not part of the Official Record 

BEST AVAILABLE IMAGES 

Defective images within this document are accurate representations of the original 
documents submitted by the applicant. 

Defects in the images include but are not limited to the items checked: 

□ BLACK BORDERS 

□ IMAGE CUT OFF AT TOP, BOTTOM OR SIDES 

□ FADED TEXT OR DRAWING 

□ BLURRED OR ILLEGIBLE TEXT OR DRAWING 

□ SKEWED/SLANTED IMAGES 

□ COLOR OR BLACK AND WHITE PHOTOGRAPHS 

□ GRAY SCALE DOCUMENTS 

□ LINES OR MARKS ON ORIGINAL DOCUMENT 
y^lwEFERENCECS) OR EXHIBIT(S) SUBMITTED ARE POOR QUALITY 

□ OTHER: 

IMAGES ARE BEST AVAILABLE COPY. 
As rescanning these documents will not correct the image 
problems checked, please do not report these problems to 
the IFW Image Problem Mailbox. 



